Job Description
Jon Description:
n
n
We are seeking an experienced Azure Databricks Engineer with 6+ years of experience in Data Engineering and strong expertise in Azure cloud technologies. The ideal candidate should have hands-on experience building scalable data pipelines using Azure Databricks, PySpark, and Azure Data Factory, along with a solid understanding of US Healthcare data models, claims, provider, member, and clinical datasets.
n
The candidate will be responsible for designing, developing, and optimizing enterprise-scale data solutions while ensuring compliance with healthcare data standards and governance requirements.
n
n
Mandatory Skills: Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Azure Synapse, ADLS Gen2, Delta Lake, US Healthcare Domain.
n
n
Key Responsibilities
n
n
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Azure Data Factory.
n
- Build and optimize data ingestion, transformation, and processing frameworks using PySpark and Spark SQL.
n
- Develop and maintain data solutions using Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, and Azure SQL.
n
- Implement Lakehouse architecture using Delta Lake and Databricks best practices.
n
- Work with large healthcare datasets including Claims, Membership, Provider, Clinical, EHR/EMR, HL7, and FHIR data.
n
- Ensure data quality, governance, security, and compliance with healthcare regulations.
n
- Perform performance tuning and optimization of Databricks clusters, notebooks, and Spark jobs.
n
- Collaborate with Data Architects, Business Analysts, Data Scientists, and Healthcare SMEs.
n
- Develop reusable frameworks and CI/CD pipelines using Azure DevOps.
n
- Support production deployments, monitoring, troubleshooting, and incident resolution.
n
n
n
Required Skills:
n
n
- 6+ years of experience in Data Engineering.
n
- 6+ years of hands-on experience with Azure Databricks.
n
- Strong expertise in:
n
- Azure Databricks
n
- PySpark
n
- Spark SQL
n
- Python
n
- SQL
n
- Azure Data Factory (ADF)
n
- Azure Data Lake Storage (ADLS)
n
- Azure Synapse Analytics
n
- Delta Lake
n
- Experience with Data Warehousing concepts, Data Modeling (Star/Snowflake Schema), and ETL/ELT development.
n
- Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
n
- Experience with Git, Azure DevOps, and CI/CD implementation.
n
- Strong understanding of performance tuning and optimization techniques in Databricks.
n
n
n
US Healthcare Experience (Mandatory)
n
n
- Minimum 2+ years of experience working in the US Healthcare domain.
n
- Strong understanding of:
n
- Claims Data
n
- Member Data
n
- Provider Data
n
- Clinical Data
n
- EHR/EMR Systems
n
- HL7/FHIR Standards
n
- HIPAA Compliance
n
- PHI/PII Data Handling
n
- Experience supporting healthcare analytics and reporting initiatives.
n
n
n
Preferred Skills
n
n
- Experience with Azure Event Hub or Kafka.
n
- Knowledge of MLflow and Databricks Workflows.
n
- Experience with Power BI.
n
- Exposure to Microsoft Purview or other Data Governance tools.
n
- Azure Data Engineer or Databricks Certification preferred.
n
n
n
Educational Qualification
n
n
- Bachelor's or master's degree in computer science, Information Technology, Engineering, or a related field.
n
n
n
Key Competencies
n
n
- Solid analytical and problem-solving skills.
n
- Excellent communication and stakeholder management skills.
n
- Ability to work independently in a fast-paced environment.
n
- Experience collaborating with global teams and business stakeholders.
n
n
n
Note:
n
Face-to-Face Interview Drive – 5-Sep-2026 | Bangalore
n
Interview Date: 5-Sep-2026
n
⏰ Interview Timing: 10:00 AM – 12:00 PM
n
Location: Bangalore – AMR Tech Park
n
Work Mode: Hybrid – 2 days WFO per week
n
Shift Timing: 2:00 PM – 11:00 PM
n
Notice Period: Immediate to 15 Days
n
Interested candidates, please share your updated profile to:
n
[email protected]
n
n
Thanks & regards,
n
Shaik Thanveer Ahamed
n
📌 Data Engineer (Bengaluru)
🏢 Sagility
📍 Bengaluru