Role & responsibilities
Expert-level knowledge of Google Cloud Platform services including:
BigQuery advanced SQL, partitioning, optimization, and cost control
Dataflow (Apache Beam) – large-scale batch and streaming data pipelines
Dataproc – Spark and Hadoop-based distributed processing
Cloud Composer (Airflow) – workflow orchestration, scheduling, and dependency management
Pub/Sub – event-driven, real-time ingestion
Cloud Storage (GCS) – data lake setup, lifecycle management, access control
Robust proficiency in Python (Pandas, PySpark, Beam SDK) and SQL for data wrangling and transformation.
Expertise in ETL/ELT design, data lake/data warehouse/lakehouse architecture.
Experience with DevOps & CI/CD using tools such as GitHub Actions,



Jenkins, or Cloud Build.
Hands-on with Terraform or Deployment Manager for Infrastructure as Code (IaC).
Solid understanding of GCP IAM, VPC, security policies, and encryption mechanisms.
Familiarity with data quality, metadata, lineage, and cataloging tools (e.g., Data Catalog).
Proficiency in cost governance, performance tuning, and resource monitoring (Cloud Monitoring/Logging).
Knowledge of up-to-date data frameworks and data integration between systems like Kafka, Snowflake, or Looker.

📌 Gcp Data Engineer Hyderabad
🏢 Tata Consultancy Services
📍 Hyderabad