Role & responsibilities

Mandatory Technical Skills
Robust experience with Cloudera Data Platform, Cloudera Runtime, HDFS, YARN, Hive, Impala
Hands-on development in Spark Structured Streaming using Scala or PySpark, including DataFrames, Spark SQL, Kafka integration, checkpointing, joins, aggregations, and performance tuning.
Hands-on development with Apache Flink using Java or Scala and Flink SQL, including DataStream or Table APIs, event-time processing, state management, checkpoints, savepoints, connectors, and job deployment.
Robust experience designing Kudu schemas, primary keys, hash and range partitions, tablet distribution, replication, upsert patterns, and query access through Impala.
Robust knowledge of Apache Kafka architecture, producers, consumers, consumer groups, partitions, offsets, retention, serialization,



schema evolution, and secure connectivity.
Proficiency in Java, Scala, or Python, with strong SQL and Linux scripting skills.
Understanding of distributed systems, fault tolerance, high availability, data consistency, and streaming delivery guarantees.
Experience troubleshooting production-grade streaming applications using logs, metrics, dashboards, and platform administration tools.

Preferred Skills
Experience with Cloudera Streaming Analytics, SQL Stream Builder, Cloudera Data Engineering.

Exposure to Git, Maven, Jenkins or similar CI/CD tools, and automated deployment

📌 Cloud Data Platform Mumbai (India)
🏢 Tata Consultancy Services
📍 India