Lead Data Engineer

Role Purpose The Lead Data Engineer is responsible for leading the design, development, and implementation of enterprise-scale data platforms, data pipelines, and analytics solutions. The role provides technical leadership to the data engineering team and works closely with business stakeholders, architects, and delivery teams to enable data-driven decision making across the organisation.

Key Responsibilities

Lead and mentor a team of Data Engineers in delivering scalable and secure data solutions.

Design and implement enterprise data lakehouse, data warehouse, and analytics platforms.

Develop and optimise ETL/ELT pipelines using Azure Data Factory and Databricks.

Implement data models and analytics platforms using Azure Synapse Analytics.

Partner with business stakeholders to translate business requirements into technical solutions.

Support Power BI semantic models, datasets, dashboards, and reporting solutions.

Establish data engineering standards, coding guidelines, and DevOps/DataOps practices.

Ensure data quality, governance, security, and compliance requirements are met.

Perform architecture reviews, code reviews, and technical assessments.

Drive continuous improvement and adoption of up-to-date data engineering practices.

Mandatory Technical Skills

Databricks (Mandatory) – Delta Lake, Unity Catalog, Medallion Architecture, Auto Loader, Spark, PySpark, Spark SQL, Workflows.

Azure Data Factory (Mandatory) – Enterprise ETL/ELT pipeline development and orchestration.

Azure Synapse Analytics (Mandatory)



– Data warehousing, SQL pools, analytics, and performance tuning.

Power BI (Mandatory) – Data modelling, DAX, semantic models, dashboards, and reporting.

Advanced SQL and database optimisation.

Python and PySpark development.

Dimensional Data Modelling and Data Warehousing.

Azure Cloud architecture and services.

Qualifications & Experience

Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science or related discipline.

Minimum 8 years of experience in Data Engineering, Analytics, or Business Intelligence.

Minimum 3 years of experience leading technical teams or major data engineering initiatives.

Proven experience delivering enterprise-scale cloud data platforms.

Preferred Certifications

Databricks Certified Data Engineer Associate OR

Databricks Certified Data Engineer Skilled (Preferred)

Microsoft Certified: Azure Data Engineer Associate (DP-203).

Microsoft Certified: Power BI Data Analyst Associate (PL-300).

Microsoft Certified: Azure Solutions Architect Expert.

Microsoft Fabric Analytics Engineer Associate (DP-600).

Leadership Competencies

Strong stakeholder management and communication skills.

Ability to lead technical discussions and architecture decisions.

Strong analytical and problem-solving capabilities.

Experience mentoring and developing engineering teams.

Ability to work across multiple projects and stakeholders.

Level : S3/S4

Years of Exp : 8 - 12 years

Position Type : Perm

Location: Bangalore

📌 Lead Data Engineer (Bengaluru)
🏢 Crimsonlogic
📍 Bengaluru