This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Databricks Engineer - Senior/Lead based in India.
This is a senior-level data engineering opportunity focused on designing and delivering scalable data platforms and analytics solutions on Microsoft Azure. You will work extensively with Azure Databricks, Python, SQL, and Apache Spark to build high-performance data pipelines and transformation workflows. The role involves working with large and complex datasets across structured and semi-structured formats while applying modern data engineering practices. You will optimize distributed processing workloads for performance, scalability, reliability, and cost efficiency. You will also collaborate with data scientists, analysts, and business stakeholders to enable analytics and machine learning use cases. This is an opportunity to take ownership of critical data engineering initiatives within a technology-driven, AI-focused setting.
n

Accountabilities:
Design, develop,



and maintain scalable data pipelines and data engineering solutions using Azure Databricks.
Build robust ETL/ELT workflows using Python, PySpark, Spark SQL, and Apache Spark.
Develop complex SQL queries and transformations to process and prepare large datasets for analytics and machine learning.
Optimize Spark jobs and distributed processing workloads for performance, scalability, reliability, and cloud cost efficiency.
Work with structured and semi-structured data formats including Parquet, Delta, JSON, and CSV.
Design, build, and maintain Delta Lake tables, leveraging capabilities such as ACID transactions, time travel, and schema evolution.
Integrate Databricks workloads with Azure Data Lake Storage Gen2 and other Azure data services.
Apply distributed computing principles to efficiently process large-scale datasets.
Implement data quality, validation, monitoring, and error-handling processes across data pipelines.
Coll

📌 Databricks Engineer (India)
🏢 Jobgether
📍 India