We are hiring Azure Databricks Data Engineers to develop ingestion frameworks and production-grade data pipelines.

Responsibilities
Develop reusable metadata/configuration-driven ingestion frameworks.
Ingest data from on-premise SQL Server.
Implement CDC, watermark and full-reload patterns.
Consume Oracle Fusion HCM/Finance data through Delta Sharing.
Build reconciliation, monitoring, failure alerting and retry mechanisms.
Configure Unity Catalog, access controls and settings.
Develop and maintain Azure DevOps CI/CD pipelines.
Build curated datasets supporting the semantic layer.
Maintain technical documentation and participate in knowledge transfer.

Qualifications
5+ years Data Engineering experience.
3+ years hands-on Azure Databricks.
Robust PySpark, Spark SQL and Delta Lake.
Metadata/configuration-driven ingestion framework experience.
SQL Server or similar incremental-load experience using CDC/change tracking/watermarks.
Unity Catalog.
Lakeflow Jobs or Azure Data Factory.
Git-based Databricks CI/CD.
Data quality, reconciliation, monitoring and alerting experience.

📌 Data Engineer – Azure Databricks Bengaluru
🏢 Birbal AI
📍 Bengaluru