Role & responsibilities

Role Overview

We are looking for highly skilled Data Engineers with strong expertise in Scala, Kafka, Spark, and GCP. The ideal candidate should have hands-on experience building scalable data pipelines, processing large volumes of data, and working directly with clients to deliver high-quality data engineering solutions.

Candidates with 8+ years of experience are expected to demonstrate team leadership, mentor junior engineers, and drive technical discussions with customers.

Mandatory Skills
- Strong hands-on experience with:
- Apache Kafka (streaming, producers/consumers, topic management)
- Apache Spark (batch & streaming)
- Scala (advanced programming expertise)

• Experience working on Google Cloud Platform (GCP)
- Solid understanding of data engineering concepts, distributed systems, and big data architectures.
- Experience working with large-scale data processing and pipeline development.
- Solid problem-solving and leadership skills. Key Responsibilities
- Lead the design and development of scalable,



fault-tolerant data pipelines and streaming architectures.
- Build and maintain real-time and batch data processing systems using Kafka, Spark, Scala and GCP
- Architect large-scale data solutions ensuring performance, reliability, and security.
- Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
- Mentor and guide junior engineers; drive best practices in coding, design, and deployment.
- Optimize data workflows and improve system efficiency and scalability.
- Implement monitoring, logging, and alerting mechanisms for data platforms.
- Drive adoption of modern data engineering practices (CI/CD, data quality frameworks, etc.).

Additional Responsibilities (For 8+ Years Experience)
- Lead a small team of engineers and provide technical guidance.
- Own technical solution design and delivery.
- Mentor junior team members and conduct code reviews.
- Drive client discussions, requireme

📌 Senior Data Engineer (Bengaluru)
🏢 IITjobs
📍 Bengaluru