Note : We need someone with solid hands-on PySpark and Apache Spark experience who can independently support job validation and guide the client team on effective validation techniques

Location is Delhi NCR

Experience Range should be above 9 Years

Senior Associate Data Engineering L2

SENIOR DATA ENGINEER L2

OVERVIEW OF ROLE
Handle client communication to design and deliver large scale Data Transformation.
Build and support large-scale batch and real-time data pipelines with data processing frameworks like AWS managed services.
Help drive optimization, testing and tooling to improve data quality and our ability to use data to make product decisions.
Work in multi-functional agile teams to continuously experiment, iterate and deliver on recent product and infrastructure objectives.
Contribute to and optimize the existing data infrastructure
Support for the integration of API calls to gather third-party vendor data.

REQUIRED QUALIFICATIONS
7 + years of experience building ETL pipeline to handle large datasets
3 + years of experience with AWS: S3, Glue,



Aurora, Databricks and other services
2+ years of experience in data modeling and database design
3 + years of experience with data modeling and/or migrating data from legacy systems
Must have robust SQL skills. Proficient in at least one of programming languages: Python, Scala, Go or Java.

PREFERRED QUALIFICATIONS
Data engineer with API development experience
Experience with Redis or any in-memory database
Relevant AWS Certifications in cloud computing, data engineering, and/or solutions architecture.
Previous developing and debugging experience in a large team
Detail-oriented with an ability to effectively multi-task in a deadline-driven atmosphere.
3 + years of experience writing and maintaining infrastructure code.
5 + years of experience using any automation tools and CI/CD pipelines
Nice to have experience in Lambda functions, IAM, Step functions, CloudWatch

📌 Senior Associate Data Engineer Gurugram (India)
🏢 Innova ESI
📍 India