Key Responsibilities:

- Design, develop, and maintain scalable ETL/ELT data pipelines on GCP.
- Build and manage data ingestion frameworks for batch and real-time data processing.
- Develop and optimize data models, data warehouses, and data lakes.
- Implement data integration solutions using GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
- Collaborate with Data Scientists, Analysts, and Business stakeholders to understand data requirements.
- Ensure data quality, governance, security, and compliance standards are maintained.
- Monitor and optimize performance, reliability, and cost efficiency of cloud-based data platforms.
- Automate data workflows using orchestration tools such as Cloud Composer (Apache Airflow).
- Troubleshoot and resolve data pipeline and platform issues.
- Support CI/CD implementation and infrastructure automation for data engineering projects.

Required Skills:





- Strong experience with Google Cloud Platform (GCP) services:

- BigQuery

- Dataflow

- Dataproc

- Pub/Sub

- Cloud Storage

- Cloud Functions

- Cloud Composer

- Cloud SQL

- Looker / Looker Studio
- Proficiency in SQL and database concepts.
- Robust programming skills in Python, Java, or Scala.
- Experience with ETL/ELT development and data integration.
- Knowledge of data warehousing and dimensional modeling concepts.
- Experience with Apache Spark, Hadoop, or distributed data processing technologies.
- Familiarity with source control systems such as Git.
- Understanding of CI/CD pipelines and DevOps practices.
- Knowledge of data security, governance, and cloud best practices.

📌 Walk-in || GCP Data Engineer - S (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru