30 Jul
|
Hexaware Technologies
|
India
30 Jul
Hexaware Technologies
India
5+ years of experience
We are seeking a skilled GCP Data Engineer to support the modernization of legacy data warehouse and ETL systems into a scalable and cloud-native architecture on Google Cloud Platform (GCP). The role involves designing, developing, and maintaining data pipelines for migration, ensuring data accuracy, performance, and operational reliability.
Responsibilities:
Design, develop, and implement ETL/ELT pipelines on GCP using BigQuery, Cloud Composer (Airflow), Dataflow, and Cloud Storage.
Analyze and convert Teradata SQL and BTEQ batch scripts into BigQuery queries and Python-based GCP pipelines.
Build and maintain batch processing workflows aligned with up-to-date cloud-native best practices.
Develop orchestration workflows in Cloud Composer to replace legacy Control-M schedules.
Perform data migration activities including ingestion,
transformation, and loading into BigQuery.
Execute unit testing, data validation, reconciliation, and support System Integration Testing (SIT).
Optimize BigQuery queries and pipelines for performance, scalability, and cost efficiency.
Develop pipeline, troubleshoot failures, and ensure production stability.
Collaborate with data architects, leads, SMEs, and DevOps teams to ensure successful delivery.
Support architecture reviews, assessments, risk mitigation planning, and technical governance throughout the migration lifecycle.
Document pipeline logic, transformation rules, and operational procedures for maintainability.
📌 Gcp Data Engineer Telangana (India)
🏢 Hexaware Technologies
📍 India