Job Description
This role will be accountable for building and maintaining scalable data pipelines from source systems. The Data Engineer will ensure the availability, reliability, and performance of data products by integrating raw data from various sources. Key responsibilities include data modeling, ETL (Extract, Transform, Load) development, and ensuring data quality and security. This role will be accountable for data coming in from 5-10+ source systems.
n

nDesign and Execute
n• Partner with data product managers to gather and deliver data pipelines.
n• Design ETL solutions including data quality, data security, and data pipeline resiliency.
n• Execute ETL solutions including data security, data quality and performance requirements.
nData Extraction, Load and Transformation
n• Design, build and implement ELT pipelines to efficiently ingest and transform data from a wide variety of data sources and deliver datasets that meet business requirements.
n• Optimize performance for large datasets and data workflows for performance, scalability,



and reliability to support business needs.
n• Develop and maintain scalable data pipelines leveraging Azure Synapse, PySpark, APIs, and SQL & performing advanced data cleaning, transformation, and manipulation to ensure high-quality, and reliable data flows.
n• Implement CI/CD processes to streamline and automate data pipelines deployment
n• Apply data validation frameworks (Excellent Expectations, Fabric-native tools) to maintain accuracy
n• Utilize partitioning, indexing, clustering strategies to enhance query performance
nProcess Improvement, Performance and Cost optimization tuning
n• Collaborate with Data Science, AI, and Data product teams to optimize performance and cost effectiveness of their solutions.
n• Identify and support the design of internal process improvements, including automating manual processes, optimizing data product delivery, and redesigning solutions for enhanced scalability.
n• Implement s

📌 Lead Data Engineer (Haryana)
🏢 McCormick
📍 Haryana