K9V Tech is looking for a highly skilled Senior Data Engineer – Azure Databricks to join our Data Engineering & Analytics practice.

The role is focused on building scalable, reliable and governed data pipelines on Microsoft Azure and Databricks, supporting enterprise Lakehouse initiatives and downstream BI, analytics and AI/ML use cases.

The candidate must have strong hands-on experience with Azure Databricks, PySpark, Python, Delta Lake and Lakehouse architecture.

Key Responsibilities

- Design, develop and maintain scalable data pipelines using Azure Databricks.
- Build Bronze, Silver and Gold data layers following Medallion Architecture.
- Develop PySpark-based data transformation pipelines.
- Build and maintain Delta Lake tables.
- Develop batch and incremental data ingestion pipelines.
- Implement data cleansing, transformation and enrichment processes.
- Work with structured and semi-structured data.
- Develop reusable and production-grade data engineering frameworks.
- Implement data-quality checks and reconciliation mechanisms.
- Monitor pipeline performance and troubleshoot production issues.
- Implement efficient data processing and optimization techniques.
- Work with Azure data services and enterprise data platforms.
- Support data modelling for analytics and BI workloads.
- Collaborate with Solution Architects, Lead Data Engineers, BI developers and business stakeholders.
- Ensure pipelines follow enterprise security, governance and development standards.
- Support deployment and orchestration of Databricks workloads.

Mandatory Technical SkillsAzure Databricks

- Strong hands-on experience with Azure Databricks.
- Strong understanding of Databricks Lakehouse architecture.
- Experience with Databricks notebooks, clusters and jobs.
- Experience with Databricks Workflows.
- Strong understanding of Delta Lake.

Data Engineering

- Strong experience with PySpark.
- Advanced Python programming.
- Strong SQL skills.




- Experience developing ETL/ELT pipelines.
- Experience with batch and incremental data processing.
- Experience handling structured and semi-structured data.
- Experience with data-quality and reconciliation processes.

Azure

- Strong understanding of Microsoft Azure data services.
- Experience with Azure Data Lake Storage Gen2 (ADLS Gen2).
- Exposure to Azure Key Vault.
- Understanding of cloud security and data governance.

Data Architecture

- Understanding of Medallion Architecture.
- Experience working with Bronze, Silver and Gold layers.
- Good understanding of dimensional data modelling.
- Understanding of scalable and reusable data-pipeline design.
- Understanding of data governance and enterprise data platforms.

Good to Have

- Databricks certification.
- Experience with Unity Catalog.
- Experience with SAP or other ERP/SaaS data sources.
- REST API integration experience.
- Experience with JSON and semi-structured data.
- Experience with CI/CD for Databricks.
- Experience supporting BI platforms such as Power BI.
- Exposure to AI/ML data requirements.

Candidate Profile

We are looking for a hands-on Senior Data Engineer who can independently develop production-quality data pipelines and work effectively in an enterprise Azure Databricks environment.

Candidates should have strong problem-solving skills, good communication abilities and the ability to work with architects, engineering teams and business stakeholders.

Application

Interested candidates can share their updated CV at:

[email protected] & [email protected]

Please mention "Senior Data Engineer – Azure Databricks" in the email subject line.

Keywords: Senior Data Engineer, Azure Data Engineer, Azure Databricks, Databricks, PySpark, Python, SQL, Delta Lake, ADLS Gen2, Azure Data Lake, Databricks Workflows, Lakehouse, Medallion Architecture, ETL, ELT, Data Engineering, Data Pipeline, Unity Catalog, Azure Cloud.

Pay: ₹1,200,000.00 - ₹1,800,000.00 per year

Advantages:

- Paid time off
- Work from home

Work Location: Remote

📌 Senior Data Engineer – Azure Databricks (India)
🏢 K9V Tech & AI
📍 India