Join the team that manages the end-to-end technology and life cycle management of the applications hosted both on premises and in the AWS cloud.
We are looking for an experienced Software Engineer with 8 to 10 years of experience to join the Data and Analytics Engineering (D&AE;) operational effectiveness team. The Associate advisor will be responsible for managing and optimizing the data pipelines for the corporate data warehouse hosted on the Teradata platform. The ideal candidate will have a robust technical background and experience in creating & managing complex data queries and pipelines.
Key Responsibilities:
- Design, develop, and maintain ETL processes to integrate data from Teradata into Databricks on AWS cloud
- Optimize and fine-tune Teradata queries, database structures, and data loading strategies to ensure high performance and scalability.
- Create and maintain data mappings, workflows, and sessions in Informatica for data extraction, transformation, and loading.
- Collaborate with data architects,
analysts and stewards to define the data requirements and ensure the availability and accuracy of the data for business users
- Monitor and troubleshoot data pipelines, resolving issues related to data integrity, performance, and job failures
- Develop and implement data validations and quality checks to ensure the accuracy and reliability of the data warehouse
- Document technical specifications, processes, and workflows related to Teradata and Informatica development
- Assist in capacity planning, performance tuning and security management
- Partner with other teams and stake holders for any clarifications needed for the timely deliverables.
- Ability to provide alternative solutions.
- Experienced with agile methodology.
Qualifications:
- Bachelor’s degree in the related field.
- 8+ years of experience in developer role.
- 6+ years of hands-on experience with Teradata database development, including query op