- Google Cloud Platform (GCP)
- Google Cloud Storage (GCS)
- BigQuery
- Cloud Composer
- Data Fusion
- Dataproc
- Python
- Terraform
- Git
- ETL / ELT
- Data Ingestion
- Google Data Engineering
Key Responsibilities:
- Configure and execute data ingestion pipelines using the GCP-based Origin Data Product (ODP) framework.
- Develop and support ETL/ELT workflows using GCS, BigQuery, Cloud Composer, Data Fusion, and Dataproc.
- Manage pipeline parameters, job configurations, and metadata.
- Troubleshoot data issues, pipeline failures, and runtime errors.
- Monitor daily job executions and ensure SLA compliance.
- Collaborate with cross-functional teams to deliver high-quality data solutions.
- Maintain infrastructure using Terraform and manage source code with Git.
- Support deployment activities and framework enhancements.
- Suggest process improvements and contribute to continuous optimization.
- Work with enterprise scheduling tools such as TWS (preferred).