Role Descriptions: Design and develop Informatica ETL workflows to meet data integration needs. Optimize AWS Glue and PySpark pipelines for data ingestion. Ensure data quality through validation and testing processes. Collaborate with teams to deliver high-quality data solutions. Support production deployments and incident management.
Essential Skills: Experience with Azure Data Services is beneficial for cloud-based data solutions. Knowledge of CI/CD and DevOps practices can enhance the development process. Familiarity with Agile/Scrum methodologies is advantageous for project management. Understanding of data warehousing concepts is practical for data modeling.
Skills in Python and Spark SQL can further support data processing tasks.Informatica ETL Development is essential for creating and maintaining data workflows. Proficiency in AWS Glue is necessary for data ingestion and transformation.
Experience with PySpark is critical for building scalable data processing solutions. Strong SQL skills are required for data validation and analysis. Familiarity with Microsoft Fabric is also important for developing data pipelines.