Data Engineering Lead (SQL, Teradata, JCL, Snowflake, Microsoft Fabric)

Location: India - 100% Remote (anywhere in India)
Engagement: Contract, long term, full time
Experience: 10+ years in data engineering / enterprise data warehousing; 2+ years as Scrum Master or Agile Delivery Lead
Work authorization: Must be based in India
Screening: Technical screen on advanced SQL, Teradata utilities and JCL

About the role

Our client, a large US consumer products and retail company, is looking for a Data Engineering Lead who also acts as Scrum Master for the data engineering team. You will own end-to-end delivery of batch and real-time pipelines across Teradata and mainframe systems, and help move data to Snowflake and Microsoft Fabric.

Responsibilities

- Lead design and delivery of scalable batch and real-time data pipelines across legacy and cloud platforms.
- Drive Teradata query tuning, physical design, partitioning (PPI) and utility automation (BTEQ, TPT, Fast Load).
- Write, maintain and debug JCL procedures, mainframe utilities (IDCAMS, SORT / DFSORT) and batch schedules feeding the data pipelines.
- Build ingestion and transformation jobs into Snowflake and Microsoft Fabric Lakehouse.
- Set coding standards, CI/CD and automated testing; run code reviews and mentor engineers.
- Work with data architects, analytics engineers,



BI developers and business users to turn requirements into technical specs.
- Act as Scrum Master: run sprint planning, stand-ups, backlog refinement, reviews and retrospectives.
- Track velocity, burndown and cycle time; remove blockers and protect the team from scope creep.
- Work with Product Owners to turn business initiatives into estimable user stories with acceptance criteria.

Required
- 10+ years in data engineering or enterprise data warehousing.
- Expert SQL: window functions, CTEs, query plans, performance tuning, indexing.
- Deep hands-on Teradata: architecture, workload management, physical design, BTEQ, TPT, Quick Load, Multi Load.
- Mainframe JCL: write, read and debug JCL, run batch processing, integrate mainframe feeds with databases.
- Data warehousing: dimensional modeling, Data Vault, star / snowflake schemas, SCD Types 1 / 2 / 4.
- 2+ years as Scrum Master or Agile Delivery Lead (Scrum / Kanban, capacity planning, Jira or Azure Dev Ops).
- Git and CI/CD (Azure Dev Ops, Git Hub Actions or Git Lab).

Preferred
- Snowflake hands-on: micro-partitioning, caching, zero-copy cloning, time travel, SnowSQL / Snowpark.
- Microsoft Fabric: One Lake, Lakehouse / Warehouse, Fabric Data Factory, Delta Lake.
- Retail domain experience.

Interview process

Recruiter screen technical round (SQL, Teradata, JCL) client manager round.

📌 Data Engineering Lead (SQL, Teradata, JCL, Snowflake, Microsoft Fabric) (India)
🏢 Digital Links
📍 India