Job Description

We are seeking an experienced Lead Data Engineer to provide technical leadership in designing, developing, and evolving scalable data solutions within a contemporary Lakehouse architecture. The role will be responsible for leading complex data engineering initiatives, defining technical approaches and development standards, and ensuring the delivery of scalable, reliable, and well-governed data products. The Lead Data Engineer will work closely with Data Architects, Business Analysts, Analytics teams, and business stakeholders to translate strategic and business requirements into robust technical solutions. The role will also provide technical guidance and mentorship to Data Engineers while ensuring alignment with the organization's data architecture and governance standards.

Key Roles & Responsibilities

- Lead the design, development, and implementation of scalable data engineering solutions within the Lakehouse environment.
- Define and drive technical approaches for data ingestion, transformation, integration, and consumption.
- Lead complex ETL/ELT development initiatives involving multiple source systems and business domains.
- Design and oversee scalable data pipelines using Azure Databricks, PySpark, SQL, and Delta Lake.
- Lead the migration of existing data assets, SQL views, transformation logic, and data models into the Lakehouse architecture.
- Define and implement data engineering standards, reusable frameworks,



and best practices.
- Design and evolve layered data architecture to support business intelligence, analytics, and future advanced data use cases.
- Ensure data models and curated datasets are optimized for scalability, performance, and business consumption.
- Review and optimize complex SQL queries, data pipelines, and processing workloads.
- Define strategies for incremental data loading, historical data management, schema evolution, and pipeline recovery.
- Establish data quality, validation, reconciliation, monitoring, and exception-handling processes.
- Ensure data solutions comply with defined governance, security, metadata, lineage, and access management requirements.
- Conduct technical reviews and provide guidance on solution design and development practices.
- Mentor and support Data Engineers in improving technical capabilities and engineering practices.
- Collaborate with Data Architects to ensure engineering solutions align with the overall data architecture.
- Work with Business Analysts and stakeholders to understand complex business requirements and convert them into scalable technical solutions.
- Support project estimation, technical planning, dependency management, and risk identification.
- Drive continuous improvement in data engineering processes, automation, performance, and maintainability.
- Awareness of ISO 14001 & 45001 Standards

📌 Principal Data Engineer (Chennai)
🏢 Konecranes
📍 Chennai