Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using GCP services.
- Build and optimize data warehouse solutions using BigQuery.
- Develop and manage complex workflows using Cloud Composer (Apache Airflow).
- Develop and deploy Google Cloud Functions integrated with various GCP services.
- Build automated data processing frameworks using Python.
- Ensure performance, reliability, security, and cost optimization of data pipelines.

Required Technical Skills
- Robust expertise in Google BigQuery data warehousing, partitioning, clustering, performance tuning, query and cost optimization.
- Hands-on experience with Cloud Composer / Apache Airflow.
- Strong Python programming skills with production-grade, reusable code.
- Experience with Google Cloud Functions and GCP integrations.
- Good knowledge of:
- Google Cloud Storage (GCS)
- Pub/Sub
- Cloud Scheduler
- Secret Manager
- IAM
- Cloud Logging
- Cloud Monitoring
- Strong SQL skills and experience handling large-scale datasets.
- Experience with REST APIs, JSON, CSV, Parquet, and Avro.
- Familiarity with Git, CI/CD, and DevOps best practices.

📌 Gcp Data Engineer (Chennai)
🏢 3shool Technology Consultants
📍 Chennai