Job DescriptionJob Title: Data Engineering Lead –

NRole Summary: We are looking for a Data Engineering Lead to lead a team of data engineers in building and delivering scalable ingestion and transformation pipelines on Databricks + AWS, ensuring engineering execution aligns with the platform's architecture and delivery timelines.

NKey Responsibilities

n

N
- Lead a team of Data Engineers delivering Bronze/Silver/Gold pipelines across batch, near-real-time, streaming, and CDC patterns
N
- Drive hands-on implementation and code/design reviews for ingestion pipelines (AWS Glue, DMS, DataSync) and streaming jobs (Kinesis, Kafka, or Databricks Structured Streaming)
N
- Own sprint planning, task allocation, and delivery tracking for the engineering pod
N
- Ensure adherence to Unity Catalog governance standards, data quality checks, and orchestration best practices (Airflow/MWAA)
N
- Troubleshoot complex pipeline/performance issues and mentor junior engineers




N
- Collaborate closely with the Data Architect to translate architecture into engineering execution
N
- Support client/stakeholder updates on engineering progress and technical blockers
N

nMust-Have Skills

N

n
- 7–10 years in data engineering, including 2+ years leading a team/pod
N
- Solid hands-on Databricks/Spark, Delta Lake, SQL, and Python/PySpark expertise
N
- Strong AWS data services experience: Glue, S3, DMS;

working knowledge of Kinesis/MSK or Kafka

N
- Solid understanding of medallion architecture, CDC ingestion, and orchestration tools
N
- Proven ability to manage delivery timelines and mentor a team
N

nGood-to-Have: Exposure to vector databases, RAG pipeline data prep, or agentic/AI tooling (Bedrock, Mosaic AI).

📌 Lead Engineer (Karnataka)
🏢 Tech Mahindra
📍 Karnataka