15 Nov
|
Lattech
|
Bengaluru
We are looking for an experienced Lead Data Engineer with 7-10 years of strong hands-on expertise in Azure Databricks, Apache Spark, PySpark, Python and SQL to lead the design and development of scalable enterprise data engineering solutions.
The ideal candidate will have experience building and optimizing large-scale data pipelines, implementing modern data lakehouse architectures, and working with Azure cloud data services. The candidate will also provide technical leadership, mentor developers, drive engineering best practices and take ownership of end-to-end project delivery.
Experience: 7–10 Years
Job Type: Full-Time
Work Mode: Remote / Hybrid (as applicable)
Primary Skills: Azure Databricks, Apache Spark, PySpark, Python, SQL, Azure Data Engineering
Domain: CPG / FMCG (Preferred)
Mandatory Technical Skills
- 7–10 years of overall experience in Data Engineering.
- Strong hands-on experience with Azure Databricks and Apache Spark.
- Excellent knowledge of PySpark, Python and SQL.
- Experience designing, developing and optimizing large-scale ETL/ELT data pipelines.
- Strong understanding of data processing, distributed computing and Spark architecture.
- Hands-on experience with Azure data services such as:
- Azure Data Factory (ADF)
- Azure Data Lake Storage Gen2 (ADLS)
- Azure Databricks
- Azure Blob Storage
- Experience working with Delta Lake, data transformation and lakehouse architecture.
- Strong understanding of data modelling, data integration and data quality.
- Experience in technical leadership, code reviews and guiding development teams.
Valuable to Have
- Experience with Azure DevOps, Git and CI/CD pipelines.
- Knowledge of Power BI and reporting concepts.
- Experience with Unity Catalog, Delta Live Tables / Lakeflow Declarative Pipelines and Databricks Workflows.
- Understanding of data warehousing, dimensional modelling and database design.
- Experience working in the CPG / FMCG domain, particularly sales, inventory, supply chain, distribution or demand forecasting data.
Pay: ₹100,000.00 - ₹150,000.00 per month
Benefits
- Flexible schedule
- Health insurance
- Paid sick time
- Work from home
Application Question(s):
- What is your notice period? (in days)
- Is salary range of Rs. 1,20,000 to Rs. 1,50,000 in hand per month agreeable for you?
Experience:
- Azure Databricks: 6 years (Required)
- Apache Spark: 6 years (Required)
- Python: 6 years (Required)
Work Location: Hybrid remote in Bengaluru, Karnataka 560000
📌 Lead Data Engineer – Azure Databricks & PySpark (Bengaluru)
🏢 Lattech
📍 Bengaluru