Job Description:-
Our client is seeking a highly skilled and experienced Data Engineering Lead with solid expertise in AWS data services and retail data ecosystems. In this role, you will lead the design, development, and optimization of scalable data pipelines responsible for ingesting and transforming data from MMS (Merchandise Management Systems) and POS (Point of Sale) systems into a centralized Operational Data Store (ODS) to support downstream applications and analytics use cases.
You will play a critical role in building a robust, high-performance data platform using AWS-native services, ensuring data quality, reliability, and real-time or near real-time availability for business operations.
Responsibilities:-
Design and implement scalable ETL/ELT pipelines to ingest data from MMS / POS or third practice systems into AWS-based data platforms. Build and maintain a centralized Operational Data Store (ODS) using Couchbase or similar No SQL technologies, optimized for low-latency application access.
Develop and optimize data processing workflows using Apache Spark / Py Spark and AWS services such as AWS Glue and Amazon EMR. Create denormalized, API-ready data models aligned with downstream microservices and application consumption patterns. Implement idempotent processing, CDC merge (upsert) strategies, and data reconciliation mechanisms to ensure consistency across batch and streaming pipelines. Leverage Amazon S3, Amazon Redshift, or Amazon Aurora for efficient storage and querying of structured and semi-structured data. Implement data ingestion patterns (batch and streaming) using tools like Amazon Kinesis or AWS Lambda where applicable. Apply performance tuning and optimization techniques to improve pipeline efficiency, scalability, and cost-effectiveness. Define and enforce data governance, data quality, and metadata management standards across the data platform. Collaborate with Dev Ops teams to design and maintain CI/CD pipelines using tools like AWS Code
📌 Lead data engineer (Gurugram)
🏢 SynapOne
📍 Gurugram
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.