We are hiring a Mid-Level Azure Databricks Developer to build and optimize healthcare data pipelines using PySpark, Spark SQL, Delta Lake, and Azure Databricks.
Requirements
- 4–5 years of data engineering experience
- 2–3+ years of hands-on Azure Databricks experience
- Strong proficiency in Python, PySpark, and SQL
- Experience with Delta Lake, Lakehouse, and bronze/silver/gold architecture
- Knowledge of ADLS Gen2, Azure Data Factory, Key Vault, and Azure DevOps
- Experience with Spark performance optimization, ETL/ELT, and CI/CD
- Understanding of HIPAA, PHI handling, and data governance
- Familiarity with Unity Catalog, Delta Live Tables, and structured streaming
Experience with HL7, FHIR, X12/EDI, CCD/C-CDA, Medicare/Medicaid data, Terraform, or Scala is preferred. Databricks or Microsoft Azure certifications are a plus.