Jon Description:

We are seeking an experienced Azure Databricks Engineer with 6+ years of experience in Data Engineering and strong expertise in Azure cloud technologies. The ideal candidate should have hands-on experience building scalable data pipelines using Azure Databricks, PySpark, and Azure Data Factory, along with a solid understanding of US Healthcare data models, claims, provider, member, and clinical datasets.
The candidate will be responsible for designing, developing, and optimizing enterprise-scale data solutions while ensuring compliance with healthcare data standards and governance requirements.

Mandatory Skills: Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Azure Synapse, ADLS Gen2, Delta Lake, US Healthcare Domain.

Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
Build and optimize data ingestion, transformation, and processing frameworks using PySpark and Spark SQL.
Develop and maintain data solutions using Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, and Azure SQL.




Implement Lakehouse architecture using Delta Lake and Databricks best practices.
Work with large healthcare datasets including Claims, Membership, Provider, Clinical, EHR/EMR, HL7, and FHIR data.
Ensure data quality, governance, security, and compliance with healthcare regulations.
Perform performance tuning and optimization of Databricks clusters, notebooks, and Spark jobs.
Collaborate with Data Architects, Business Analysts, Data Scientists, and Healthcare SMEs.
Develop reusable frameworks and CI/CD pipelines using Azure DevOps.
Support production deployments, monitoring, troubleshooting, and incident resolution.

Required Skills:
6+ years of experience in Data Engineering.
6+ years of hands-on experience with Azure Databricks.
Solid expertise in:
Azure Databricks
PySpark
Spark SQL
Python
SQL
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS)
Azure Synapse Analytics
Del

📌 Data Engineer (Bengaluru)
🏢 Sagility
📍 Bengaluru