Job Description - Data Engineering Lead

Experience: 8-15 Years
Role: Data Engineering Lead

Role Overview

We are looking for an experienced Data Engineering Lead with 8-15 years of experience in designing and delivering scalable data engineering solutions, leading data engineering teams, and driving data architecture and governance initiatives.

The ideal candidate should have robust hands-on expertise in SQL, Python, PySpark, ETL technologies, cloud data platforms, data warehousing, data modeling, orchestration, and distributed data processing. The candidate will be responsible for leading data engineering teams, designing scalable data architectures, optimizing data pipelines, and ensuring high standards of performance, quality, security, and governance.

Key Responsibilities

Data Engineering & Architecture
- Lead the design, development, and implementation of scalable and reliable data engineering solutions.
- Define and implement data architecture, data models, data pipelines, and data integration frameworks.




- Design and optimize batch and real-time data processing solutions across cloud environments.
- Establish technical standards, best practices, and reusable frameworks for data engineering.
- Drive the adoption of modern cloud data platforms and data engineering technologies.

ETL & Data Pipeline Development
- Design, develop, and optimize complex ETL/ELT pipelines using technologies such as Informatica PowerCenter, Databricks, AWS Glue, and Snowflake.
- Lead ETL modernization and migration initiatives from traditional platforms to cloud-based data platforms.
- Optimize pipeline performance, resource utilization, processing time, and overall data flow.
- Design robust orchestration and dependency management using Apache Airflow.
- Implement monitoring, logging, error handling, data validation, and recovery mechanisms for critical pipelines.

Cloud Data Platforms
- Design and implement data solutions across AWS, Azure, and GCP environments.
- Work with cl

📌 Lead Data Engineer (Chennai)
🏢 fluid.live
📍 Chennai