You'll build and optimize the serving stack that makes Vikasit Inference rapid, reliable, and affordable at India scale — kernels, batching, caching, and the OpenAI-compatible API surface developers love.
What you'll do
- —Optimize throughput and latency across our model fleet (vLLM / SGLang / TensorRT-LLM)
- —Build batching, KV-cache, quantization, and routing for MoE models
- —Own reliability, autoscaling, and cost of the inference platform
- —Keep the OpenAI-compatible API rock-solid for streaming and tool calls
What we're looking for
- —Deep systems engineering (GPU, CUDA-adjacent, or high-performance serving)
- —Experience with an LLM serving framework in production
- —Comfort owning latency, throughput, and cost SLOs