Job Description

Description

n

We are looking for a Senior Databricks Data Engineer with solid expertise in Databricks, data engineering, and healthcare data. The ideal candidate will be responsible for designing scalable, secure, and high-performance data platforms supporting healthcare analytics and data integration.

n

The candidate should have robust knowledge of modern data architecture, Lakehouse architecture, SQL, Python, data governance, and healthcare domain workflows.

n

Responsibilities

n

n
Design and lead Databricks Lakehouse for large-scale healthcare data platforms.
n
Design data ingestion, transformation, storage, and consumption patterns using Databricks.
n
Develop Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables/Lakeflow .
n
Integrate data from multiple healthcare sources, including clinical, claims, eligibility, provider, and patient systems.
n
Design robust ETL/ELT pipelines using PySpark, SQL, and Databricks.
n
Establish data quality, validation, reconciliation, lineage, and governance frameworks.
n
Design secure healthcare data solutions while considering HIPAA and PHI/PII protection requirements.
n
Work with cloud platforms such as Azure, AWS, or GCP to build scalable data solutions.




n
Collaborate with data engineers, data scientists, analysts, product owners, and business stakeholders.
n
Define technical standards, architectural patterns, and best practices for Databricks development.
n
Lead performance optimization and cost-management initiatives across the Databricks platform.
n
Provide technical leadership and mentoring to data engineering teams.
n
Participate in Agile ceremonies and contribute to technical planning and roadmap discussions.
n

n

Qualifications

n

n
Strong hands-on experience with Databricks .
n
Expertise in Lakehouse architecture and Delta Lake.
n
Strong PySpark and SQL skills.
n
Experience with Unity Catalog and data governance.
n
Experience designing enterprise-scale data platforms.
n
Robust knowledge of ETL/ELT and data modeling.
n
Experience with cloud platforms such as Azure, AWS, or GCP .
n
Experience with data integration and orchestration tools.
n
Knowledge of CI/CD, Git, and DevOps practices.
n
Strong understanding of data security and access control.
n
Experience with Agile/Scrum methodologies.
n

n

📌 Data Engineer Noida
🏢 EXL
📍 Noida