10 Sep
|
Tech Mahindra
|
Maharashtra
10 Sep
Tech Mahindra
Maharashtra
Job Title: Data Engineering Lead –Role Summary:We are looking for a Data Engineering Lead to lead a team of data engineers in building and delivering scalable ingestion and transformation pipelines onDatabricks + AWS, ensuring engineering execution aligns with the platform's architecture and delivery timelines.Key ResponsibilitiesLead a team of Data Engineers deliveringBronze/Silver/Goldpipelines across batch, near-real-time, streaming, and CDC patternsDrive hands-on implementation and code/design reviews for ingestion pipelines ( AWS Glue, DMS, DataSync ) and streaming jobs ( Kinesis, Kafka, or Databricks Structured Streaming )Own sprint planning, task allocation, and delivery tracking for the engineering podEnsure adherence to Unity Catalog governance standards, data quality checks,
and orchestration best practices ( Airflow/MWAA )Troubleshoot complex pipeline/performance issues and mentor junior engineersCollaborate closely with the Data Architect to translate architecture into engineering executionSupport client/stakeholder updates on engineering progress and technical blockersMust-Have Skills7–10 yearsin data engineering, including2+ yearsleading a team/podStrong hands-onDatabricks/Spark ,Delta Lake ,SQL, andPython/PySparkexpertiseStrongAWS data servicesexperience: Glue, S3, DMS; working knowledge of Kinesis/MSK or KafkaSolid understanding of medallion architecture, CDC ingestion, and orchestration toolsProven ability to manage delivery timelines and mentor a teamGood-to-Have:Exposure to vector databases, RAG pipeline data prep, or agentic/AI tooling (Bedrock, Mosaic AI).
📌 Lead Engineer (Maharashtra)
🏢 Tech Mahindra
📍 Maharashtra