Job Description

We're Hiring: Lead Data Engineer – Supply Chain

n

Role: Lead Data Engineer

n

Domain: Data Engineering | Supply Chain | AI

n

Experience: 6+ Years

n

Location: Pune

n

Work Mode: Hybrid

n

About the Role

n

We are looking for an experienced Lead Data Engineer with strong hands-on expertise in Data Engineering and Supply Chain to design and build scalable, real-time, and batch data platforms.

n

The ideal candidate should have strong experience in Python, PySpark, Advanced SQL, data transformations, system integrations, and Supply Chain workflows, along with exposure to AI and Agentic solutions.

n

Key Responsibilities

n

Design and build real-time and batch data ingestion pipelines for AI-based Supply Chain solutions.

n

Develop complex data transformation, cleansing, enrichment, and reconciliation workflows.

n

Integrate data from REST APIs, databases, files, enterprise systems, and streaming sources.

n

Develop ETL tools and validation routines for complex Supply Chain workflows.

n

Build reusable Python and SQL components for ingestion and transformation.

n

Implement schema evolution, incremental loads, retries, error handling, and data recovery.

n





Understand agentic structures and create data solutions/models for optimization engines.

n

Implement data quality checks, monitoring, logging, alerting, and audit controls.

n

Review technical designs and guide data engineers on implementation standards.

n

Required Skills

n

6+ years of hands-on experience in Data Engineering

n

Strong experience with Supply Chain data management and transformation

n

Strong Python & PySpark development skills

n

Advanced SQL, including complex joins and query optimization

n

Robust understanding of ETL/ELT design patterns

n

Experience with REST APIs, JSON, CSV, MongoDB, and OLAP engines

n

Experience developing Agents and Agentic solutions/designs

n

Strong understanding of data modelling, schema design, partitioning, and schema evolution

n

Experience with pipeline observability, data validation, monitoring, and alerting

n

Hands-on experience with Git, CI/CD, Docker, and Kubernetes

n

Interested candidates can share their updated resume at: [email protected]

n

WhatsApp: (phone hidden)

n

References would be highly appreciated!

📌 Lead Data Engineer (Pune)
🏢 ProSapiens HR
📍 Pune