06 Aug
|
Crimsonlogic
|
Bengaluru
06 Aug
Crimsonlogic
Bengaluru
Role Purpose
The Lead Data Engineer is responsible for leading the design, development, and implementation of enterprise-scale data platforms, data pipelines, and analytics solutions. The role provides technical leadership to the data engineering team and works closely with business stakeholders, architects, and delivery teams to enable data-driven decision making across the organisation.
Key Responsibilities
Lead and mentor a team of Data Engineers in delivering scalable and secure data solutions.
Design and implement enterprise data lakehouse, data warehouse, and analytics platforms.
Develop and optimise ETL/ELT pipelines using Azure Data Factory and Databricks.
Implement data models and analytics platforms using Azure Synapse Analytics.
Partner with business stakeholders to translate business requirements into technical solutions.
Support Power BI semantic models, datasets, dashboards, and reporting solutions.
Establish data engineering standards, coding guidelines, and DevOps/DataOps practices.
Ensure data quality, governance, security, and compliance requirements are met.
Perform architecture reviews, code reviews, and technical assessments.
Drive continuous improvement and adoption of up-to-date data engineering practices.
Mandatory Technical Skills
Databricks (Mandatory) – Delta Lake, Unity Catalog, Medallion Architecture, Auto Loader, Spark, PySpark, Spark SQL, Workflows.
Azure Data Factory (Mandatory) – Enterprise ETL/ELT pipeline development and orchestration.
Azure Synapse Analytics (Mandatory) – Data warehousing, SQL pools, analytics, and performance tuning.
Power BI (Mandatory) – Data modelling, DAX, semantic models, dashboards, and reporting.
Advanced SQL and database optimisation.
Python and PySpark development.
Dimensional Data Modelling and Data Warehousing.
Azure Cloud architecture and services.
Qualifications & Experience
Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science or related discipline.
Minimum 8 years of
📌 Technical Lead (Bengaluru)
🏢 Crimsonlogic
📍 Bengaluru