Data Engineering Lead-Azure Data bricks, SQl,Python,Spark,Airflow (Bengaluru)

Data Engineering Lead-Azure Data bricks, SQl,Python,Spark,Airflow (Bengaluru)

16 Oct
|
Optum India
|
Bengaluru

16 Oct

Optum India

Bengaluru

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy advantages, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities

• Design, develop, test, and deploy scalable data pipelines using Azure Databricks, Spark SQL, Python, and Airflow
• Build and maintain data ingestion, transformation, and data curation processes across multiple enterprise data sources
• Develop complex SQL queries and optimize data processing workflows for performance and scalability
• Create, maintain, and support Airflow DAGs for orchestration, scheduling, monitoring, and error handling
• Collaborate with Product Owners,



Business Analysts, and stakeholders during requirements gathering, backlog refinement, and sprint planning activities
• Implement data quality validations, reconciliation checks, and exception handling mechanisms
• Support the development and maintenance of Delta Lake and Lakehouse architectures within Databricks
• Participate in data platform modernization and cloud migration initiatives
• Develop reusable frameworks, utilities, and automation solutions to improve engineering efficiency
• Troubleshoot pipeline failures, performance bottlenecks, and complex data issues
• Follow coding standards, security requirements, and engineering best practices
• Contribute to CI/CD implementation and automated deployment processes
• Work closely with cross-functional teams to support analytics, reporting, AI, and business operational needs
• Prepare and maintain technical documentation, design specifications

📌 Data Engineering Lead-Azure Data bricks, SQl,Python,Spark,Airflow (Bengaluru)
🏢 Optum India
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineering lead-azure data bricks, sql,python,spark,airflow (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: data engineering lead-azure data bricks, sql,python,spark,airflow (bengaluru) / bengaluru