16 Aug
|
NXP Semiconductors
|
Noida
16 Aug
NXP Semiconductors
Noida
We are seeking an experienced Data Platform Engineer to join our core platform team. In this role, you will be responsible for building, securing, and automating our enterprise Data Platform on AWS. You will go beyond basic pipeline creation by designing and maintaining the underlying infrastructure and CI/CD frameworks that enable our data teams to operate and scale efficiently.
Job Responsibilities
• Cloud & Platform Infrastructure (IaC): Deploy and maintain Databricks workspaces and AWS infrastructure (VPC, PrivateLink, IAM, S3, Lambda, EKS, and Fargate) using Terraform.
• Unity Catalog Implementation: Automate the governance layer, including metastore configuration, external locations, and access controls within Unity Catalog.
• Security & Compliance: Ensure the platform adheres to enterprise security standards by managing implementing cloud infrastructure and data protection automated security controls.
• Workspace Lifecycle Management: Use Terraform for end-to-end workspace provisioning, ensuring consistent setup across Dev, Acc, and Prod environments.
• Governance & Cost Control (Policies): Design and implement policies and guardrails to enforce standards
• Identity & Access Automation: Automate assignment of permissions using Terraform. Manage Service Principals for pipelines and map groups to specific Workspace roles and Unity Catalog grants.
• DevOps & Automation (CI/CD)
• Pipeline Architecture: Oversee GitLab CI/CD pipelines for data projects, transitioning the team from manual notebook deployments to automated workflows.
• Databricks Asset Bundles (DABs): Standardize deployment strategies using DABs. Develop templates and presets for Data Engineers to deploy jobs and workflows.
• Release Management: Implement branching strategies, code review policies, and setting promotion rules (Dev → Acc → Prod).
• Service Organization & Operations
• Observability: Configure monitoring, alerting, and logging (using system tables or integration with tools like Clou
📌 Data Platform DevOps Engineer (Noida)
🏢 NXP Semiconductors
📍 Noida