Developing and maintaining ETL processes to support data integration and transformation
- Utilizing Apache Airflow and Directed Acyclic Graphs (DAGs) for workflow automation and orchestration
- Implementing data architecture development and optimization strategies to enhance data pipeline efficiency
- Leveraging Amazon Web Services (AWS) and Microsoft Azure Databricks for scalable data solutions
- Conducting data validation and quality checks to maintain data integrity and reliability
- Collaborating with cross-functional teams to design and implement data warehouse solutions using Snowflake and other platforms
- Performing database administration and optimization tasks to improve system performance
- Applying analytical thinking to solve complex data engineering challenges and improve data infrastructure
- Building and managing data lakes and warehouses to support advanced analytics and reporting needs
- Engaging in continuous learning and adaptation to embrace current technologies and methodologies in data engineering
What You Must Have
- At least a Bachelor's degree
- At least 4 years of experience
- Oral and written proficiency in English required
- ETL Automation Engineer + Guidewire Insurance