Job description:

Lead data engineer Lead Data Engineer
Role Summary
We are seeking a highly skilled and experienced Lead Data Engineer to drive the modernization and design the future-state architecture of our Sales Validation platform. As a technical leader, you will be responsible for guiding the transition from legacy systems to advanced data engineering solutions, primarily focused on Databricks and Azure cloud technologies. This role requires a passion for innovation, performance optimization, and building scalable, reusable engineering frameworks.
Key Responsibilities
• Lead the architecture, implementation, and delivery of Databricks solutions to support data processing and analytics initiatives.
• Oversee the migration efforts from Synapse Analytics to Databricks, ensuring minimal downtime and aligned best practices.
• Develop and enforce engineering standards, reusable frameworks, and documentation to promote consistency and efficiency across teams.
• Mentor data engineers through design reviews, knowledge sharing sessions,



and technical guidance to foster qualified growth and code quality.
• Own end-to-end delivery of multiple complex workstreams, coordinate across teams, and manage technical risks.
• Drive continuous performance tuning and scalability improvements for data pipelines and platforms.
• Collaborate with cross-functional teams including data scientists, architects, and business stakeholders to deliver aligned solutions.

Technical Skills Required
Databricks Ecosystem (Highest Priority):
• Advanced experience with Databricks and Spark frameworks using PySpark and Spark SQL.
• Deep understanding of Delta Lake architecture and Unity Catalog for secure data governance.
• Practical knowledge of Databricks workflows and asset bundles to orchestrate data pipelines effectively.
• Expertise with modern Lakehouse architecture principles to integrate data lakes and warehouses.

Microsoft Azure Platform:
• Hands-on experience architecting and managing

📌 TECHNICAL LEAD (Chennai)
🏢 Wipro
📍 Chennai