06 Sep
|
Arminus
|
Bengaluru
Consultant | Azure Databricks | Bengaluru | Engineering
Budget – INR 150-200K
Description:
Job description
- 6–8 years of experience in data engineering.
- Strong hands-on experience with Databricks on Azure.
- Robust experience with PySpark and large-scale data processing.
- Proven experience designing and implementing ETL/ELT pipelines in Azure.
- Solid experience with Azure services such as ADLS, Key Vault, etc.
- Strong SQL and data warehousing concepts; experience with orchestration tools (e.g., Databricks Jobs) preferred.
- Strong experience in performance tuning and optimization of PySpark/Databricks jobs.
- Hands-on experience with monitoring and logging for data pipelines (e.g.Databricks workflows logs).
- Exposure to data quality frameworks and practices (validation, reconciliation, error handling).
- Experience conceptualizing and delivering PoCs and converting them into scalable production-ready solutions.
- Willing to work in 2nd shift and Hybrid mode and work from client office.
📌 Consultant | Azure Databricks | Bengaluru
🏢 Arminus
📍 Bengaluru