Job Title: Data Engineering Lead – Role Summary: We are looking for a Data Engineering Lead to lead a team of data engineers in building and delivering scalable ingestion and transformation pipelines on Databricks + AWS, ensuring engineering execution aligns with the platform's architecture and delivery timelines.Key ResponsibilitiesLead a team of Data Engineers delivering Bronze/Silver/Gold pipelines across batch, near-real-time, streaming, and CDC patternsDrive hands-on implementation and code/design reviews for ingestion pipelines (AWS Glue, DMS, DataSync) and streaming jobs (Kinesis, Kafka, or Databricks Structured Streaming)Own sprint planning, task allocation, and delivery tracking for the engineering podEnsure adherence to Unity Catalog governance standards, data quality checks,



and orchestration best practices (Airflow/MWAA)Troubleshoot complex pipeline/performance issues and mentor junior engineersCollaborate closely with the Data Architect to translate architecture into engineering executionSupport client/stakeholder updates on engineering progress and technical blockersMust-Have Skills7–10 years in data engineering, including 2+ years leading a team/podStrong hands-on Databricks/Spark, Delta Lake, SQL, and Python/PySpark expertiseStrong AWS data services experience: Glue, S3, DMS; working knowledge of Kinesis/MSK or KafkaSolid understanding of medallion architecture, CDC ingestion, and orchestration toolsProven ability to manage delivery timelines and mentor a teamGood-to-Have: Exposure to vector databases, RAG pipeline data prep, or agentic/AI tooling (Bedrock, Mosaic AI).

📌 Lead Engineer (Bengaluru)
🏢 Tech Mahindra
📍 Bengaluru