23 Oct
|
Innova ESI
|
Bengaluru
23 Oct
Innova ESI
Bengaluru
Role : AWS Data Engineer
Experience : 7+ Years
Location : PAN India
Immediate Joiners Only.
SENIOR DATA ENGINEER
OVERVIEW OF ROLE
- Handle client communication to design and deliver large scale Data Transformation.
- Build and support large-scale batch and real-time data pipelines with data processing frameworks like AWS managed services.
- Help drive optimization, testing and tooling to improve data quality and our ability to use data to make product decisions.
- Work in multi-functional agile teams to continuously experiment, iterate and deliver on current product and infrastructure objectives.
- Contribute to and optimize the existing data infrastructure
- Support for the integration of API calls to gather third-party vendor data.
REQUIRED QUALIFICATIONS
- 7 + years of experience building ETL pipeline to handle large datasets
- 3 + years of experience with AWS: S3, Glue, Aurora, Databricks and other services
- 2+ years of experience in data modeling and database design
- 3 + years of experience with data modeling and/or migrating data from legacy systems
- Must have strong SQL skills. Proficient in at least one of programming languages: Python, Scala, Go or Java.
PREFERRED QUALIFICATIONS
- Data engineer with API development experience
- Experience with Redis or any in-memory database
- Relevant AWS Certifications in cloud computing, data engineering, and/or solutions architecture.
- Previous developing and debugging experience in a large team
- Detail-oriented with an ability to effectively multi-task in a deadline-driven atmosphere.
- 3 + years of experience writing and maintaining infrastructure code.
- 5 + years of experience using any automation tools and CI/CD pipelines
- Nice to have experience in Lambda functions, IAM, Step functions, CloudWatch
📌 AWS Data Engineer - Pyspark | Apache Spark (Bengaluru)
🏢 Innova ESI
📍 Bengaluru