Experience: 2.50 years

Salary: Confidential (based on experience)

Shift: (GMT 05:30) Asia/Kolkata (IST)

Opportunity Type: Office ()

Placement Type: Full time Permanent Position

(*Note: This is a requirement for one of Uplers' client - Blurgs AI)

What do you need for this opportunity?

Must have skills required

Apache Kafka, Confluent, RedPanda, Microservice-based ETL, Streaming data pipeline

Blurgs AI is Looking for:

Build and operate the core data pipeline of a high-scale, event-driven platform. You will own the streaming ETL that ingests telemetry, enriches and transforms it through Flink/Faust, and stores it in ClickHouse/PostGIS for sub-second analytical and historical queries — deployed on self-managed Kubernetes in air-gapped or regulated environments.

What You'll Own

- Pipeline reliability — exactly-once Flink enrichment, at-least-once Faust analytics, zero data loss at high throughput

- ClickHouse schema and tiering — DDL, materialized views, TTL policies, async-insert tuning, ingestion watermarks and reconciliation jobs

- Faust state management — RocksDB-backed per-entity state (Kalman, anomaly hot-windows), partition rebalancing across deployment tiers

- Redpanda operations — topic design, partition strategy, retention, compaction, consumer-group lag monitoring and backpressure admission control

- Observability — trace_id propagation, latency histograms, DLQ routing, consumer-lag HPA metrics

- Data supply chain — offline SBOM, air-gapped package verification, immutable reference data deployment

Must-Have Requirements (3 years)

- Kafka or Kafka-equivalent streaming backbone experience — any production variant (Apache Kafka, Confluent, Redpanda, etc.)

- Microservice-based ETL on streaming data — must have built stream processing logic inside microservices,



not through SQL queries or orchestration-only tools

- Production streaming data pipeline experience — hands-on experience on a live, high-velocity, continuous time-series data pipeline at scale

Good to Have

- Apache Flink (Java/DataStream API) — checkpointing, stateful processing, exactly-once sinks

- Faust (Python) or Kafka Streams — stateful stream processing, worker scaling

- ClickHouse or any columnar/OLAP database at scale (Redshift, Aurora, TimescaleDB also acceptable)

- Air-gapped, bare-metal, or regulated environment experience

- Multi-language proficiency across Python, Java, and Scala simultaneously

- Technical mentorship or team lead experience

- CMMI Level 5 / ISO 25010 documentation discipline — ADRs, SDD sections, RTM traceability

Non-Negotiables

- No cloud-only experience — must be comfortable operating self-managed infrastructure

- Comfortable writing design pseudo-code (Python/Java/SQL) that becomes implementation

- Documentation-as-code mindset

How to apply for this opportunity?

- Step 1: Click On Apply! And Register or Login on our portal.

- Step 2: Complete the Screening Form & Upload updated Resume

- Step 3: Increase your chances to get shortlisted & meet the client for the Interview!

About Uplers

Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement.

(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).

So, if you are ready for a new challenge, a great work environment, and an chance to take your career to the next level, don't hesitate to apply today. We are waiting for you!

📌 Data Engineer II (Bengaluru)
🏢 Uplers
📍 Bengaluru