Lead Data Engineer – Azure Databricks & PySpark (Bengaluru)

Lead Data Engineer – Azure Databricks & PySpark (Bengaluru)

15 Nov
|
Lattech
|
Bengaluru

15 Nov

Lattech

Bengaluru

We are looking for an experienced Lead Data Engineer with 7-10 years of strong hands-on expertise in Azure Databricks, Apache Spark, PySpark, Python and SQL to lead the design and development of scalable enterprise data engineering solutions.

The ideal candidate will have experience building and optimizing large-scale data pipelines, implementing modern data lakehouse architectures, and working with Azure cloud data services. The candidate will also provide technical leadership, mentor developers, drive engineering best practices and take ownership of end-to-end project delivery.

Experience: 7–10 Years

Job Type: Full-Time

Work Mode: Remote / Hybrid (as applicable)

Primary Skills: Azure Databricks, Apache Spark, PySpark, Python, SQL, Azure Data Engineering

Domain: CPG / FMCG (Preferred)

Mandatory Technical Skills

- 7–10 years of overall experience in Data Engineering.
- Strong hands-on experience with Azure Databricks and Apache Spark.
- Excellent knowledge of PySpark, Python and SQL.
- Experience designing, developing and optimizing large-scale ETL/ELT data pipelines.
- Strong understanding of data processing, distributed computing and Spark architecture.
- Hands-on experience with Azure data services such as:
- Azure Data Factory (ADF)
- Azure Data Lake Storage Gen2 (ADLS)
- Azure Databricks




- Azure Blob Storage
- Experience working with Delta Lake, data transformation and lakehouse architecture.
- Strong understanding of data modelling, data integration and data quality.
- Experience in technical leadership, code reviews and guiding development teams.

Valuable to Have

- Experience with Azure DevOps, Git and CI/CD pipelines.
- Knowledge of Power BI and reporting concepts.
- Experience with Unity Catalog, Delta Live Tables / Lakeflow Declarative Pipelines and Databricks Workflows.
- Understanding of data warehousing, dimensional modelling and database design.
- Experience working in the CPG / FMCG domain, particularly sales, inventory, supply chain, distribution or demand forecasting data.

Pay: ₹100,000.00 - ₹150,000.00 per month

Benefits

- Flexible schedule
- Health insurance
- Paid sick time
- Work from home

Application Question(s):
- What is your notice period? (in days)
- Is salary range of Rs. 1,20,000 to Rs. 1,50,000 in hand per month agreeable for you?

Experience:
- Azure Databricks: 6 years (Required)
- Apache Spark: 6 years (Required)
- Python: 6 years (Required)

Work Location: Hybrid remote in Bengaluru, Karnataka 560000

📌 Lead Data Engineer – Azure Databricks & PySpark (Bengaluru)
🏢 Lattech
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer – azure databricks & pyspark (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer – azure databricks & pyspark (bengaluru) / bengaluru