15 Sep
|
Tata Consultancy Services
|
Bengaluru
15 Sep
Tata Consultancy Services
Bengaluru
Job Description
n
- Dear Professionals,
n
- Greetings from Tata Consultancy Services (TCS)!!!
n
- Job Title : Senior GCP Data Engineer
n
- Experince : 6-10 Years
n
- Location: Hyderabad/Bangalore
n
- Mode of Interview : Virtual
n
- Expert-level knowledge of Google Cloud Platform services including:
n
- BigQuery – advanced SQL, partitioning, optimization, and cost control
n
- Dataflow (Apache Beam) – large-scale batch and streaming data pipelines
n
- Dataproc – Spark and Hadoop-based distributed processing
n
- Cloud Composer (Airflow) – workflow orchestration, scheduling, and dependency management
n
- Pub/Sub – event-driven, real-time ingestion
n
- Cloud Storage (GCS) – data lake setup, lifecycle management, access control
n
- Strong proficiency in Python (Pandas, PySpark, Beam SDK) and SQL for data wrangling and transformation.
n
- Expertise in ETL/ELT design, data lake/data warehouse/lakehouse architecture.
n
- Experience with DevOps & CI/CD using tools such as GitHub Actions, Jenkins, or Cloud Build.
n
- Hands-on with Terraform or Deployment Manager for Infrastructure as Code (IaC).
n
- Solid understanding of GCP IAM, VPC, security policies, and encryption mechanisms.
n
- Familiarity with data quality, metadata, lineage, and cataloging tools (e.g., Data Catalog).
n
- Proficiency in cost governance, performance tuning, and resource monitoring (Cloud Monitoring/Logging).
n
- Knowledge of contemporary data frameworks and data integration between systems like Kafka, Snowflake, or Looker.
n
📌 Senior GCP Data Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru