19 Nov
|
Movate Technologies
|
Bengaluru
19 Nov
Movate Technologies
Bengaluru
Confluent Cloud & Kafka
Experience: 10- 15 Years
Location: Bangalore/Chennai
Work Mode: WFO
Shift: General Shift
Movate is looking for a Senior Confluent Cloud Kafka & Flink Engineer to design, develop and implement enterprise-scale real-time data streaming platforms and event-driven solutions. The role will translate business use cases into secure, reliable and production-grade streaming architectures using Confluent Cloud, Apache Kafka, Confluent Cloud for Apache Flink and modern cloud data platforms. The ideal candidate is a hands-on Confluent specialist with strong solution-architecture capability, deep streaming engineering experience and the ability to independently design, build, deploy and support complete real-time data solutions, rather than focusing only on Kafka administration.
Key Responsibilities
- Lead the architecture, design and implementation of enterprise-scale streaming solutions using Confluent Cloud, Apache Kafka and Confluent Cloud for Apache Flink. • Design Kafka topics, producers, consumers, partitions and replication strategies for scalable and reliable event processing. • Build and manage Kafka Connect integrations, managed connectors and Change Data Capture (CDC) pipelines. • Develop Flink SQL solutions for streaming transformations, joins, aggregations, windowing and event-time processing. • Configure and optimize Confluent Flink compute pools, materialized tables and streaming workloads. • Implement Confluent Tableflow integrations with Apache Iceberg, Delta Lake and cloud data platforms. • Design schemas using Avro, JSON Schema and Protobuf, and manage compatibility, versioning and schema evolution through Schema Registry.
• Establish stream governance using Stream Catalog, Stream Lineage, data contracts and enterprise governance practices. • Automate Confluent Cloud infrastructure and setting management using the Confluent Terraform Provider. • Integrate streaming deployments with CI/CD pipelines and implement repeatable DevOps practices across environments. • Implement security controls using RBAC, ACLs, service accounts, API keys and secure REST API integrations. • Design and support Cluster Linking and Schema Linking for multi-cluster and cross-environment streaming requirements. • Deliver end-to-end use cases involving CDC, streaming ETL, real-time analytics, event-driven architectures and data-lake integration. • Troubleshoot production issues and improve platform monitoring, performance, reliability, scalability and cost efficiency. • Provide technical leadership, architecture guidance, code/design reviews and knowledge sharing across engineering teams.
Required Technical Skills
- 10+ years of overall engineering experience with strong hands-on experience in Confluent Cloud and Apache Kafka. • Strong hands-on experience with Confluent Cloud for Apache Flink and Flink SQL. • Deep understanding of Kafka topics, producers, consumers, partitioning, Kafka Connect, managed connectors and CDC. • Experience with streaming transformations, joins,
aggregations, windowing and event-time processing. • Experience with Schema Registry, Avro, JSON Schema, Protobuf, schema compatibility, versioning and evolution. Movate | Senior Confluent Cloud Kafka & Flink Engineer • Hands-on experience with Terraform, preferably the Confluent Terraform Provider, infrastructure automation and CI/CD pipelines. • Experience implementing Kafka security using RBAC, ACLs, service accounts and API keys. • Good understanding of Cluster Linking, Schema Linking and multi-environment streaming architectures. • Proficiency in SQL and working knowledge of Java or Python. • Proven experience designing and delivering production-grade streaming use cases. • Strong troubleshooting, architecture, problem-solving, communication and stakeholder-management skills. Preferred Skills • Knowledge of Confluent Tableflow and integration with Apache Iceberg or Delta Lake. • Experience with AWS, Microsoft Azure or Google Cloud Platform. • Exposure to Databricks and modern lakehouse architectures. • Confluent certifications or relevant streaming-platform credentials. • Experience optimizing streaming-platform performance, reliability and cloud cost. • Prior technical leadership, architecture ownership, mentoring or cross-team enablement experience.
Qualifications
- Bachelor's degree in Computer Science, Engineering or a related discipline, or equivalent practical experience.
- Ability to translate business requirements into end-to-end real-time streaming architectures.
- Ability to independently design, develop, deploy and support enterprise-grade streaming solutions
📌 Senior Confluent Cloud Kafka & Flink Engineer (Bengaluru)
🏢 Movate Technologies
📍 Bengaluru