Job Description

Overall Exp-5+

n

Location-Pan India

n

Job Requirements*

n

n
- Proficiency in programming languages: Python, Java
n
- Expertise in data processing frameworks: Apache Beam (Data Flow)
n
- Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc.,
n
- Data Engineering skillset using Python, SQL
n
- Experience in ETL (Extract, Transform, Load) processes
n
- Knowledge of DevOps tools like Jenkins, GitHub, Terraform is desirable. Should have valuable knowledge on Kafka (Batch/ streaming)
n
- Understanding of Data models and experience in performing ETL design and build, database replication using Message based CDC
n
- Familiarity with cloud storage solutions
n
- Strong problem-solving abilities in data engineering challenges
n
- Understanding of data security and scalability
n
- - Proficiency in relevant tools like Apache Airflow
n

n

Core Skills:

n

n
- GCP Services: BigQuery, Dataflow, Cloud Storage, Pub/Sub, Data Catalog, Data Fusion, AI Platform.
n
- Programming: SQL, Python, Java/Scala (for Dataflow/Spark).
n
- Data Concepts:



Data Warehousing, ETL, Data Modeling, Streaming.
n
- Tools: Apache Beam, Docker, Kubernetes, Git, Terraform.
n

n

Key Responsibilities*

n

n
- Design & Build Data Pipelines: Develop scalable data ingestion, transformation (ETL/ELT), and orchestration workflows using GCP services.
n
- GCP Service Utilization: Implement solutions with BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Cloud Composer.
n
- Data Integration: Connect and manage data from diverse sources (APIs, databases, files).
n
- Optimization: Improve performance, cost-efficiency, and reliability of data processes.
n
- Collaboration: Work with data scientists, analysts, and architects to meet data needs.
n
- Quality & Security: Ensure data integrity, security, and compliance.
n
- Automation: Implement CI/CD and Infrastructure as Code (IaC) using tools like Terraform.
n
- Monitoring & Support: Maintain, monitor, and troubleshoot data workloads and systems.
n

📌 GCP Data Engineer (New Delhi)
🏢 Tata Consultancy Services
📍 New Delhi