ABOUT THE ROLE

REMOTE IN INDIA

We're looking for a software engineer to build the Kubernetes-native control
plane that provisions and runs our GPU inference fleet. You'll design a
manifest-driven API where the inference team declares what they need, whether
that's a cluster, a model deployment, or a capacity change, and our controllers
handle the reconciliation, provider/runtime selection, and lifecycle management
underneath, so the inference team never has to know or care which specific
serving stack, scheduler, or hardware pool is doing the work. You'll also build
the systems that keep the fleet efficient, not just running, including
defragmentation and rebalancing logic that consolidates scattered workloads back
into contiguous capacity, and scheduling/bin-packing improvements that push GPU
utilization up without hurting latency. The core value we're after is decoupling
the people building on top of the platform from the operational and runtime
complexity underneath, while squeezing more usable capacity out of the same
hardware. You'll build the controllers,



reconciliation loops, and self-service
surface (API/CLI, not tickets) that make that decoupling real, plus the
event-driven health, remediation, and utilization systems that keep it running
and efficient without a human in the loop. Robust candidates have hands-on
experience with Kubernetes controller/CRD patterns, have built or operated a
platform API that abstracts multiple backends behind one interface, understand
GPU scheduling and capacity efficiency (fragmentation, bin-packing,
right-sizing), and think about GPU infrastructure as software to be engineered.

A product mindset - you've built internal platforms or APIs consumed by other
engineering teams and care about the developer experience of what you ship.You
build it, you own it. You are not only responsible for delivering the software
but also for operating and supporting it in production.

RESPONSIBILITIES

* Build the provisioning state machine:

📌 Junior/Senior or Staff Software Engineer, Inference (India)
🏢 Together AI
📍 India