14 Nov
|
Tata Consultancy Services
|
Kolkata
14 Nov
Tata Consultancy Services
Kolkata
Job highlights
- 5+ years experience in GCP data engineering with expertise in BigQuery, Dataflow, Pub/Sub, Cloud Composer, Python, and SQL
- Design and develop scalable ETL/ELT pipelines, build data warehouses and lakes, develop batch and real-time ingestion frameworks, optimize BigQuery models, ensure data quality and compliance, and collaborate with stakeholders
Job Title: GCP Data Engineer
Experience: 6+ Years
Location: Bangalore, Chennai, Kolkata
We are looking for an experienced GCP Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data solutions on Google Cloud Platform.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines using GCP services.
- Build and maintain data warehouses and data lakes.
- Develop data ingestion frameworks for batch and real-time processing.
- Create optimized BigQuery data models and ensure data quality.
- Work closely with business stakeholders, data analysts, and data scientists.
- Implement monitoring, troubleshooting, and performance tuning for data pipelines.
- Ensure security, governance, and compliance standards are followed.
Required Skills
- Strong experience in Google Cloud Platform (GCP).
- Hands-on experience with:
- BigQuery
- Dataflow
- Pub/Sub
- Cloud Composer (Airflow)
- Cloud Storage
- Cloud Functions
- Solid programming skills in Python.
- Expertise in SQL and data modeling.
- Experience in ETL/ELT development and optimization.
- Knowledge of CI/CD, Git, and Agile methodologies.
- Experience with real-time data processing is preferred.
Preferred Skills
- DBT knowledge.
- Terraform/Infrastructure as Code.
- Spark/PySpark experience.
Eligibility
- 5+ years of IT experience with relevant Data Engineering experience.
- Strong communication skills.
📌 GCP Data Engineer (Kolkata)
🏢 Tata Consultancy Services
📍 Kolkata