Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own We have a flexible work environment and fluid career paths We not only encourage but celebrate internal mobility We also recognize the importance of purpose well-being and work-life balance Within Empower and our communities we work hard to create a welcoming and inclusive environment and our associates dedicate thousands of hours to volunteering for causes that matter most to them Chart your own path and grow your career while helping more customers achieve financial freedom Empower Yourself Empower-Retirement is looking for an experienced Lead Data Engineer with experience in implementing ELT ETL data pipelines AWS data ecosystems pipelines and transformations with Python As a Sr Data Engineer you will be responsible for building maintaining and implementing ELT ETL pipelines and database structures The Sr Data Engineer will be responsible for the data lifecycle and will collaborate with other developers on the team The Sr Data Engineer will work with internal technology teams in order to understand and aid in the implementation of database and data transformation requirements in order to deliver enterprise reporting solutions Duties Responsibilities Essential Functions Design and build data structures throughout all stages of the data lifecycle raw refined analytics report ready Maintain and optimize existing data structures throughout all stages of the data lifecycle raw refined analytics report ready Build ELT ETL Python scripts to source data from various systems to conform to reporting database structures Maintain and optimize current Python ELT ETL scripts processes and data structures Validate data and transformations throughout the entire data lifecycle Analyze data discrepancies throughout all stages of the data lifecycle to determine root cause and identify correct course of action Integrate up-and-coming data management and software engineering technologies into existing data structures Document data lineage source to target data transformations business logic calculations data dictionary Validate data and transformations throughout the entire data lifecycle Work with team to validate expectations and accuracy of the data with business and development leaders Provide guidance on automated data QA checks throughout data lifecycle Design construct install test and maintain data management systems Ensure that all systems meet the business company requirements as well as industry practices Employ an array of technological languages and tools to connect systems together Collaborate with members of your team the project deliverables goals Install update disaster recovery procedures Recommend different ways to constantly improve data reliability and quality Train and mentor others on the team on best practices techniques and languages Education Bachelor s degree in computer science software computer engineering applied mathematics or physics statistics REQUIRED QUALIFICATIONS 6 years of Python programming experience using python packages such as numpy pandas etc to manipulate and transform data from application web to server side Strong experience using Python on event-drive programming familiar with using python lists classes dictionaries to build module functions etc Has experience analyzing mapping and connecting with various source system data Solid experience with building and maintaining ETL ELT pipelines using Python Strong experience with Postgres and PSQL writing data transformation and data structures Strong working and conceptual knowledge of building and maintaining physical and logical data models Excellent communication skills with the ability to collaborate with non-technical partners Experience working in an Agile workplace working on a Scrum team Strong understanding of concepts or experience with ETL and ELT Data piplines Data Warehousing and Data Marts Kimball Vs Inmon architecture patterns TDD Source control CI CD DevOps OTHER PREFERRED QUALIFICATIONS Experience with BI ETL tools Informatica SSIS Alteryx in creating ELT ETL and augmented data workflows for data or reporting deliverables Experience in cloud-based data engineering in AWS Cloud EC2 CloudFrontRoute5 API Gateway CloudWatch CloudTrail CloudFormation RDS Redshift DynamoDB S3 Aurora Experience working in AWS Glue Lambda Step EMR Data Pipeline Kenisis Athena Quicksight strongly preferred Experience with Business Intelligence end-to-end implementation and requirements gathering in Tableau Power BI or Snowflake in strongly desired Familiarity with Scala Java Net This is not intended to be an exhaustive list of all duties responsibilities and qualifications of the job The employer has the right to revise this at any time You will be evaluated in part based on your performance of the responsibilities and or tasks listed in this You may be required perform other duties that are not included on this The is not a contract for employment and either you or the employer may terminate employment at any time for any reason as per terms and conditions of your employment contract We are an equal opportunity employer with a commitment to diversity All individuals regardless of personal characteristics are encouraged to apply All qualified applicants will receive consideration for employment without regard to age race color national origin ancestry sex sexual orientation gender gender identity gender expression marital status pregnancy religion physical or mental disability military or veteran status genetic information or any other status protected by applicable state or local law

📌 Lead Engineer Data (Bengaluru)
🏢 Empower Annuity Insurance
📍 Bengaluru