Role :Senior Data Engineer (Senior Associate – Data Engineering)

Experience:
9+ Years

Location:
Delhi NCR Immediate Joiners Only. We are looking for an experienced Senior Data Engineer with strong hands-on expertise in PySpark and Apache Spark who can independently support job validation, optimize data pipelines, and guide client teams on effective data validation techniques. ?

Key Responsibilities
• Design, develop, and support large-scale batch and real-time data pipelines.
• Build and optimize ETL/ELT pipelines using PySpark, Apache Spark, and AWS services.
• Perform job validation, troubleshoot issues, and ensure data quality and accuracy.
• Guide client teams on data validation strategies and best practices.
• Develop and optimize data transformation workflows and data models.
• Integrate third-party vendor data through APIs.
• Collaborate with cross-functional teams to deliver scalable data engineering solutions.




• Contribute to infrastructure optimization, automation, and CI/CD initiatives. ? Required Skills ✅ Strong hands-on experience with PySpark and Apache Spark✅ 7+ years of experience building ETL pipelines for large datasets✅ 3+ years of experience with AWS services such as S3, Glue, Aurora, and Databricks✅ Strong SQL and Python programming skills✅ Experience in data modeling, database design, and legacy data migration✅ Good understanding of data quality, job validation, and pipeline optimization ? Valuable to Have
• API development and Redis or other in-memory database experience
• AWS Lambda, IAM, Step Functions, and CloudWatch
• Infrastructure as Code (IaC), automation tools, and CI/CD pipelines
• Relevant AWS certifications

📌 Senior Data Engineer (India)
🏢 Innova ESI
📍 India