Immediate Openings! AWS Data Engineer*

Mandatory Skills:Python,SQL,AWS Migration,DataLake,Snowflake

Exp:4-5 Years

Location:Bangalore(Hybrid-3 Days)

NP:Immediate-One Week Max

Immediate-Serving Candidates Preferrable!*

Kindly Drop your profile to [email protected]

Role Overview The Engineer will be part of the datastore-migration Factory team, responsible for the end-to-end datastore migration from an on-prem DataLake to an AWS-hosted LakeHouse. This is a high-visibility and crucial project.

Basic Qualifications

- Bachelor's or Master's in Computer Science, Applied Mathematics, Engineering, or a related quantitative field.

Technical Skills
- A total of 4+ years of experience in the field of Data Engineering.
- Minimum of 35 years of professional "hands-on-keyboard" coding experience in a collaborative, team-based environment.
- In-depth proficiency in SQL, Python/Java, and working experience using RESTful APIs with Swagger and automation; understand request/response and investigate using developer tools.
- Good knowledge of the on-prem Data Lake built on the Hadoop ecosystem with HDFS, and understanding of how the ecosystem operates.




- Experience with AWS S3 data staging and synchronous/asynchronous data sync techniques into a Lakehouse.
- Excellent experience handling CI/CD pipelines, stages, child pipeline management, investigating pipeline logs, and root cause analysis.
- Ability to execute end-to-end migration of Legacy Data Lake data stores to a Lakehouse in the cloud using available tooling.
- Ability to investigate issues with tooling during data migration, perform root cause analysis, and report issues promptly to different collaborating tooling teams, tracking them to closure.
- Experience translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg.
- Solid understanding of milestoning and temporal data modeling (unitemporal, bitemporal, etc.); Temporal Data Modeling managing state changes over time (e.g., SCD Type 2).
- Strong experience with data reconciliation frameworks (using complex SQL queries) that perform various recon checks per industry standards to ensure migrated data is functionally equivalent.
- Good understanding of Schema Evolution Management strategies and enforcement approaches.

📌 BI-CBFEB-Data Engineer Datastore Migration-Bangalore (Bengaluru)
🏢 Bounteous
📍 Bengaluru