common ETL patterns and establish scalable design standards. • Build, test, deploy, and support data pipelines and orchestration workflows. • Collaborate with business stakeholders to translate requirements into technical solutions. • Drive performance optimization, reliability, and operational excellence across data platforms. Required Skills • 10+ years of experience in Data Engineering, ETL Development, and Data Warehousing. • Strong development experience in PySpark, Python, and SQL. • Hands-on experience with: o AWS EMR Serverless o AWS Glue o AWS Step Functions o AWS EventBridge o Amazon S3 o Apache Airflow • Strong database experience, preferably DB2, Snowflake and Amazon Athena. • Advanced SQL skills include complex joins, window functions, CTEs, performance tuning, and data reconciliation. • Experience with Informatica PowerCenter and the ability to understand and analyze existing ETL implementations. • Solid analytical, problem-solving, and communication skills. • Ability to work independently and take ownership from design through production deployment.
Preferred Skills • Experience building metadata-driven and reusable ETL frameworks. • Experience with large-scale ETL modernization and cloud migration initiatives. • Knowledge of data quality, data governance, and reconciliation processes. Nice to Have • Experience integrating external systems through REST APIs using Python/PySpark. • Exposure to CI/CD pipelines and DevOps practices. • Experience with Medallion Architecture (Bronze, Silver, Gold) • Insurance domain experience.