Detailed

- 5+ years of experience in data engineering.

- Robust hands-on experience with Databricks on Azure.

- Strong experience with PySpark and large-scale data processing.

- Proven experience designing and implementing ETL/ELT pipelines in Azure.

- Solid experience with Azure services such as ADLS, Key Vault, etc.

- Strong SQL and data warehousing concepts;

experience with orchestration tools (e.g., Databricks Jobs) preferred.

- Strong experience in performance tuning and optimization of PySpark/Databricks jobs.

- Hands-on experience with monitoring and logging for data pipelines (e.g.Databricks workflows logs).

- Exposure to data quality frameworks and practices (validation, reconciliation, error handling).

- Experience conceptualizing and delivering PoCs and converting them into scalable production-ready solutions.

- Willing to work in 2nd shift and Hybrid mode and work from client office.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Azure Databricks professional (Bengaluru)
🏢 IBU Consulting
📍 Bengaluru