02 Sep
|
NXP Semiconductors
|
Bengaluru
02 Sep
NXP Semiconductors
Bengaluru
Position Summary:
We are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks. This is a Databricks-focused Data Engineering role with a working understanding of DevOps practices — designing scalable pipelines, tuning workloads for performance and cost, and operationalizing contemporary data and AI capabilities on Lakehouse.
The ideal candidate has deep, hands-on Databricks expertise, a solid performance-engineering instinct, and a builder's mindset for AI-assisted operations. You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations.
Key Responsibilities:
Design and develop scalable data pipelines and Lakehouse solutions on Databricks.
Tune Databricks workloads for performance and cost, including cluster sizing, query optimization, and Delta Lake table design.
Establish and enforce best practices for partitioning, clustering, and workload isolation.
Track performance trends,
identify high-cost queries, and partner with source teams and end users to resolve long-running loads.
Design and operationalize Unity Catalog for data governance — access control, lineage, and security.
Build monitoring and self-healing automation using Databricks-native AI and agentic capabilities.
Drive CI/CD workflows for Databricks assets, setting DevOps best practices for deployment and release management.
Lead design reviews and mentor Data Engineers on Databricks best practices and AI-native features.
Own Databricks vendor coordination — case management, escalations, and release adoption strategy.
What Success Looks Like (First 6–12 Months)
Within 6–12 months, you'll define the platform's tuning and governance standards, lead design reviews, mentor junior engineers, and shape the AI-native operations roadmap.
Required Qualifications:
Bachelor's or Master's degree in Computer Scienc
📌 Lead Data Engineer Bengaluru
🏢 NXP Semiconductors
📍 Bengaluru