Role: Data Engineer / Senior Data Engineer GCP, Scala & Kafka

Experience: 6-10 Years

Location: Pan India

Virtual Interview: 01-Oct-26

Job Summary

We are seeking an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP), Scala, and Apache Kafka to build and maintain scalable, high-performance data processing solutions. The ideal candidate should have experience in real-time data streaming, distributed systems, cloud-native architectures, and large-scale data platforms.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines using Scala.
- Build and manage real-time streaming solutions using Apache Kafka.
- Develop data ingestion, transformation, and processing frameworks on GCP.
- Work with BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub services.
- Optimize data processing workloads for performance, scalability, and reliability.
- Collaborate with Data Scientists, Analysts, and Application Teams to support business requirements.
- Implement monitoring, logging,



and troubleshooting for data pipelines.
- Ensure data quality, governance, security, and compliance standards.

Required Skills

- 6-10 years of overall IT experience.
- Strong hands-on experience in Scala programming.
- Experience with Apache Kafka, Kafka Streams, Kafka Connect, and event-driven architectures.
- Hands-on experience with Google Cloud Platform (GCP) services such as:

- BigQuery

- Dataflow

- Dataproc

- Pub/Sub

- Cloud Storage

- Composer
- Experience in ETL/ELT and real-time data processing.
- Robust SQL and database skills.
- Knowledge of Spark and distributed processing frameworks.
- Experience with CI/CD, Git, and DevOps practices.

Preferred Skills

- Spark/Scala development.
- GCP certification.
- Experience with Kubernetes and Docker.
- Exposure to Airflow/Cloud Composer.
- Knowledge of Data Lake and Data Warehouse concepts.

📌 Data Engineer- GCP, Scala & Kafka (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru