We are hiring Azure Databricks Data Engineers to develop ingestion frameworks and production-grade data pipelines.

Responsibilities

- Develop reusable metadata/configuration-driven ingestion frameworks.
- Ingest data from on-premise SQL Server.
- Implement CDC, watermark and full-reload patterns.
- Consume Oracle Fusion HCM/Finance data through Delta Sharing.
- Build reconciliation, monitoring, failure alerting and retry mechanisms.
- Configure Unity Catalog, access controls and environments.
- Develop and maintain Azure DevOps CI/CD pipelines.
- Build curated datasets supporting the semantic layer.
- Maintain technical documentation and participate in knowledge transfer.

Qualifications

- 5+ years Data Engineering experience.
- 3+ years hands-on Azure Databricks.
- Robust PySpark, Spark SQL and Delta Lake.
- Metadata/configuration-driven ingestion framework experience.
- SQL Server or similar incremental-load experience using CDC/change tracking/watermarks.
- Unity Catalog.
- Lakeflow Jobs or Azure Data Factory.
- Git-based Databricks CI/CD.
- Data quality, reconciliation, monitoring and alerting experience.

📌 Data Engineer – Azure Databricks (Bengaluru)
🏢 Birbal AI
📍 Bengaluru