Big Data Architect (Pune)

Big Data Architect (Pune)

13 Aug
|
TripStack
|
Pune

13 Aug

TripStack

Pune

The role - Tripstack is moving its entire data stack from bare-metal VMs to Kubernetes on OpenStack in a new data centre. We are looking for a senior infrastructure engineer who has done stateful migrations before, who can plan, codify, and execute this one safely, and who will own the day-to-day operational health of the data platform once we are there. This is a hands-on platform and SRE role with a clear, time-bounded mission. You will partner closely with our SRE team on networking, hardware, and Kubernetes fundamentals. You will own the data end to end on the data applications Druid, Spark, Redpanda, Airflow, PostgreSQL, and Elasticsearch. This is not a machine learning role. We have a separate plan for evolving our MLFlow platform, and the right hire here may grow into more of that work over time, but day-one impact is the migration and the operational health of the platform.

Responsibilities :
Lead the data-stack migration -
- Plan and execute the migration of Druid, Spark, Redpanda, and our orchestration layer from bare-metal VMs to Kubernetes on OpenStack,



with no downtime on stateful workloads.
- Design StatefulSet, PVC, pod-disruption-budget, and rolling-upgrade patterns that are protected for production data systems.
- Codify the migration with Infrastructure as Code Terraform for OpenStack, Helm or Kustomize for Kubernetes, GitOps via ArgoCD or Flux so the result is reproducible and supportable by the whole team.

Operate the data platform -
- Own the operational health of our production data systems, including Druid, Spark, Redpanda, Airflow, PostgreSQL, and Elasticsearch. You'll handle segment lifecycle, JVM tuning, ingestion specs, broker/coordinator/overlord internals, partition design, consumer lag, and replication tuning
- Build the KPIs, alerting, dashboards, and runbooks that let us see cluster exhaustion before it becomes an incident, and diagnose it quickly when it does.
- Own the query, report, segment, and tiering optimisations that keep our ana

📌 Big Data Architect (Pune)
🏢 TripStack
📍 Pune

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: big data architect (pune) / pune

Subscribe to this job alert:

Get the latest job offers by email for: big data architect (pune) / pune