Role & responsibilities

Role Overview

We are looking for highly skilled Data Engineers with strong expertise in Scala, Kafka, Spark, and GCP. The ideal candidate should have hands-on experience building scalable data pipelines, processing large volumes of data, and working directly with clients to deliver high-quality data engineering solutions.

Candidates with 8+ years of experience are expected to demonstrate team leadership, mentor junior engineers, and drive technical discussions with customers.

Mandatory Skills

- Strong hands-on experience with:
- Apache Kafka (streaming, producers/consumers, topic management)
- Apache Spark (batch & streaming)
- Scala (advanced programming expertise)

• Experience working on Google Cloud Platform (GCP)

- Solid understanding of data engineering concepts, distributed systems, and big data architectures.
- Experience working with large-scale data processing and pipeline development.
- Strong problem-solving and leadership skills. Key Responsibilities
- Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures.
- Build and maintain real-time and batch data processing systems using Kafka, Spark, Scala and GCP
- Architect large-scale data solutions ensuring performance, reliability, and security.
- Collaborate with data scientists, analysts,



and business stakeholders to deliver data-driven solutions.
- Mentor and guide junior engineers; drive best practices in coding, design, and deployment.
- Optimize data workflows and improve system efficiency and scalability.
- Implement monitoring, logging, and alerting mechanisms for data platforms.
- Drive adoption of modern data engineering practices (CI/CD, data quality frameworks, etc.).

Additional Responsibilities (For 8+ Years Experience)

- Lead a small team of engineers and provide technical guidance.
- Own technical solution design and delivery.
- Mentor junior team members and conduct code reviews.
- Drive client discussions, requirement gathering, and technical presentations.
- Coordinate with stakeholders to ensure timely project delivery.

Required Qualifications

- 512 years of overall experience in Data Engineering.
- Excellent communication and stakeholder management skills.
- Strong analytical and problem-solving abilities.
- Ability to work in a fast-paced, client-facing setting.

What We’re Looking For

- Strong technical depth in Data Engineering.
- Excellent communication skills.
- Client-facing experience.
- Ownership mindset with the ability to work independently.
- Leadership capability for candidates with 8+ years of experience.

Preferred candidate profile

📌 Senior Data Engineer (Karnataka)
🏢 IITjobs
📍 Karnataka