06 Aug
|
Hexaware Technologies
|
Hyderabad
06 Aug
Hexaware Technologies
Hyderabad
- 5+ years of experience
We are seeking a skilled GCP Data Engineer to support the modernization of legacy data warehouse and ETL systems into a scalable and cloud-native architecture on Google Cloud Platform (GCP). The role involves designing, developing, and maintaining data pipelines for migration, ensuring data accuracy, performance, and operational reliability.
Responsibilities:
- Design, develop, and implement ETL/ELT pipelines on GCP using BigQuery, Cloud Composer (Airflow), Dataflow, and Cloud Storage.
- Analyze and convert Teradata SQL and BTEQ batch scripts into BigQuery queries and Python-based GCP pipelines.
- Build and maintain batch processing workflows aligned with contemporary cloud-native best practices.
- Develop orchestration workflows in Cloud Composer to replace legacy Control-M schedules.
- Perform data migration activities including ingestion,
transformation, and loading into BigQuery.
- Execute unit testing, data validation, reconciliation, and support System Integration Testing (SIT).
- Optimize BigQuery queries and pipelines for performance, scalability, and cost efficiency.
- Develop pipeline, troubleshoot failures, and ensure production stability.
- Collaborate with data architects, leads, SMEs, and DevOps teams to ensure successful delivery.
- Support architecture reviews, assessments, risk mitigation planning, and technical governance throughout the migration lifecycle.
- Document pipeline logic, transformation rules, and operational procedures for maintainability.
📌 Gcp Data Engineer (Hyderabad)
🏢 Hexaware Technologies
📍 Hyderabad