Location: India

Location: India

Work Mode: Remote

Employment Type: Full time

Experience: 5 to 10 Years

About the Role

We are seeking an experienced Senior Data Engineer Azure Databricks to design, develop, and optimize enterprise-scale data engineering solutions and modern cloud-based data platforms. The ideal candidate brings deep, hands-on expertise in Azure Databricks, PySpark, Python, SQL, Azure Data Factory (ADF), and Azure Cloud, alongside strong experience building scalable data pipelines and implementing automated CI/CD via Azure DevOps.

In this role, you will work closely with data architects, engineers, analysts, and business stakeholders to build reliable, high-performance data platforms, optimize distributed Spark workloads, and mentor growing engineering talent.

Key Responsibilities
- Data Pipeline Engineering: Design, build, and maintain scalable end-to-end ETL/ELT pipelines and complex processing workflows using Azure Databricks, PySpark, Python, and SQL.
- Orchestration & Integration:



Build and orchestrate data ingestion workflows using Azure Data Factory (ADF) to integrate data from diverse structured and unstructured enterprise sources into Azure Data Lake Storage (ADLS Gen2).
- Lakehouse Architecture & Modeling: Implement scalable Lakehouse and Medallion architectures, designing data models and data warehousing solutions to support downstream analytics, reporting, and business applications.
- Performance & Cost Optimization: Audit and optimize Databricks jobs, Spark workloads, SQL queries, memory management, and data pipelines for peak performance and cloud cost efficiency.
- CI/CD & DevOps: Build and manage automated CI/CD deployment pipelines using Azure DevOps across Development, QA, and Production environments.
- Platform Governance & Quality: Develop reusable data engineering frameworks, ensure data quality, reliability, security, and governance across data platforms, and troubleshoot production pipeline failures and data issues.
- En

📌 Senior Data Engineer (Mumbai)
🏢 Aura Recruitment Solutions
📍 Mumbai