Need an experienced Data Engineer with robust expertise in Azure Databricks, Azure Data Services, and Python to design, develop, and optimize scalable data pipelines and analytics solutions.
Responsibilities
- Design, build, and maintain scalable data pipelines using Azure data services and Azure Databricks
- Develop and optimize ETL/ELT workflows for batch and real-time processing
- Implement data solutions leveraging Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Databricks
- Experience in writing SQL queries (SQL and Postgres DB)
- Write efficient, reusable, and scalable code in Python (PySpark preferred)
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
- Ensure data quality, consistency,
and governance across platforms
- Optimize data processing performance and cost efficiency in cloud environments
- Implement CI/CD pipelines and DevOps practices for data engineering workflows
- Monitor and troubleshoot production data pipelines and workflows
- Document data architecture, data flows, and technical designs
Requirements
- Strong experience in Azure Data Services, including: Azure Databricks, Python, SQL or Postgres
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics (or SQL Data Warehouse)
📌 Sr. Expert - Data Engineering (Pune)
🏢 VOLKSWAGEN GROUP DIGITAL SOLUTIONS PRIVATE
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.