16 Nov
|
Tata Consultancy Services
|
Kolkata
16 Nov
Tata Consultancy Services
Kolkata
Job highlights
5+ years experience in GCP data engineering with expertise in BigQuery, Dataflow, Pub/Sub, Cloud Composer, Python, and SQL
Design and develop scalable ETL/ELT pipelines, build data warehouses and lakes, develop batch and real-time ingestion frameworks, optimize BigQuery models, ensure data quality and compliance, and collaborate with stakeholders Job Title: GCP Data Engineer
Experience:
6+ Years
Location:
Bangalore, Chennai, Kolkata
Job Description
We are looking for an experienced GCP Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data solutions on Google Cloud Platform.
Key Responsibilities
Design and develop scalable ETL/ELT data pipelines using GCP services.
Build and maintain data warehouses and data lakes.
Develop data ingestion frameworks for batch and real-time processing.
Create optimized BigQuery data models and ensure data quality.
Work closely with business stakeholders, data analysts,
and data scientists.
Implement monitoring, troubleshooting, and performance tuning for data pipelines.
Ensure security, governance, and compliance standards are followed. Required Skills
Robust experience in Google Cloud Platform (GCP).
Hands-on experience with:
BigQuery
Dataflow
Pub/Sub
Cloud Composer (Airflow)
Cloud Storage
Cloud Functions
Robust programming skills in Python.
Expertise in SQL and data modeling.
Experience in ETL/ELT development and optimization.
Knowledge of CI/CD, Git, and Agile methodologies.
Experience with real-time data processing is preferred. Preferred Skills
DBT knowledge.
Terraform/Infrastructure as Code.
Spark/PySpark experience. Eligibility
5+ years of IT experience with relevant Data Engineering experience.
Robust communication skills.
📌 Gcp Data Engineer Kolkata
🏢 Tata Consultancy Services
📍 Kolkata