30 Sep
|
Tata Consultancy Services
|
Bengaluru
30 Sep
Tata Consultancy Services
Bengaluru
Role & responsibilities
- Design, build, and maintain scalable data pipelines on Google Cloud Platform for Vodafone programs
- Develop and optimize BigQuery datasets, views, and queries for analytics and reporting use cases
- Implement batch and realtime ingestion pipelines using Dataproc, Dataflow, and Pub/Sub
- Orchestrate workflows using Cloud Composer (Airflow)
- Perform data transformations, cleansing, and enrichment using Python and SQL
- Ensure data quality, reliability, and performance across pipelines
- Work closely with architects, analytics teams, and business stakeholders to understand data requirements
- Support production deployments, monitoring, and issue resolution
- Participate in Agile ceremonies including sprint planning, reviews, and retrospectives
Preferred candidate profile
- 510 years of experience as a Data Engineer, with strong exposure to GCPbased data platforms
- Handson experience with Google BigQuery, including data modeling, optimization, and performance tuning
- Strong experience in batch and streaming data pipelines using Data-proc, Data-flow, and Cloud Composer (Airflow)
- Experience working with GCP services such as Pub/Sub, Cloud Storage, Big Query, Data-proc, Cloud Composer, and Cloud Functions
- Strong programming skills in Python and SQL for data processing and transformation
- Experience in building endtoend data ingestion pipelines from multiple source systems
- Positive understanding of telecom data domains such as CDRs, network events, customer, usage, and billing data (Vodafone preferred)
- Experience working in Agile delivery models with geographically distributed teams
- Knowledge of data quality, data validation, and reconciliation frameworks
- Familiarity with CI/CD pipelines and GCP monitoring/logging tools
- Strong communication, analytical, and problemsolving skills
📌 Gcp Data Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru