02 Oct
|
Dhruv Technology Solutions
|
Bengaluru
02 Oct
Dhruv Technology Solutions
Bengaluru
Core Responsibility Summary
Deploys, operates, and evolves the Kafka / Flink / ClickHouse platform on Kubernetes across multiple factory data centers. Ensures the platform is reliable, observable, performant, and ready for data engineering teams to build on top of.
Kubernetes & Container Platform
• Deep Kubernetes expertise (workload types, scheduling, resource requests/limits, namespaces, RBAC)
• Kubernetes operators for stateful systems — Strimzi (Kafka), Flink Kubernetes Operator, ClickHouse Operator (Altinity)
• Helm chart authoring and management (not just consumption — writing and maintaining charts)
• StatefulSet management, persistent volume claims, storage class configuration
• Multi-cluster and multi-site Kubernetes deployments
• Node affinity, taints/tolerations, pod disruption budgets for workload isolation
• Kubernetes networking: services, ingress, network policies, DNS
• Secrets management (Kubernetes secrets, Vault integration, or equivalent)
Platform Component Expertise
Kafka
• Kafka cluster sizing, broker configuration, topic design (partitions, replication,
retention)
• Strimzi operator — KafkaNodePool, KafkaTopic, KafkaUser, KafkaMirrorMaker2 CRDs
• Kafka Connect cluster deployment and connector lifecycle management
• Kafka security: TLS, mTLS, SASL, ACLs
• Kafka upgrade and rolling restart procedures with zero data loss
Flink
• Flink cluster deployment modes on Kubernetes (Application mode, Session mode)
• Flink Kubernetes Operator — FlinkDeployment, FlinkSessionJob CRDs
• Checkpointing and savepoint management (S3 or distributed storage backends)
• Flink HA configuration (Kubernetes-native HA or ZooKeeper)
• Job submission, monitoring, and restarts without data loss
ClickHouse
• ClickHouse cluster deployment with Altinity operator or ClickHouse Operator
• Shard and replica topology design for multi-factory deployments
• Storage configuration: tiered storage, disk policies, S3-backed cold storage
• Backup and restore strategies
• ClickHouse
📌 Platform Engineer (Bengaluru)
🏢 Dhruv Technology Solutions
📍 Bengaluru