Consultant | Azure Databricks | Bengaluru | Engineering
Budget – INR 150-200K
Description:
Job description
6–8 years of experience in data engineering.
Solid hands-on experience with Databricks on Azure.
Robust experience with PySpark and large-scale data processing.
Proven experience designing and implementing ETL/ELT pipelines in Azure.
Solid experience with Azure services such as ADLS, Key Vault, etc.
Robust SQL and data warehousing concepts; experience with orchestration tools (e.g., Databricks Jobs) preferred.
Strong experience in performance tuning and optimization of PySpark/Databricks jobs.
Hands-on experience with monitoring and logging for data pipelines (e.g.Databricks workflows logs).
Exposure to data quality frameworks and practices (validation, reconciliation, error handling).
Experience conceptualizing and delivering PoCs and converting them into scalable production-ready solutions.
Willing to work in 2nd shift and Hybrid mode and work from client office.
📌 Consultant Azure Databricks Bengaluru (India)
🏢 Arminus
📍 India