Consulting Engineer – AI Inference Infrastructure (Remote)
Commitment: 20 hrs/week (Flexible)
Duration: 6–12 weeks (Renewable)
Location: Remote (Weekly overlap with US Pacific time required)
About PrimaLabs
PrimaLabs is building a workload-specific AI inference serving platform that maximizes real-world accelerator performance through closed-loop autotuning.
We're looking for experts in one or two of the following areas:
Disaggregated Inference
KV Cache Systems (LMCache, HiCache, etc.)
Speculative Decoding
Inference Routing & Gateway
Serving Stack Engineering (vLLM, SGLang, NVIDIA Dynamo)
Throughput & Latency Optimization
Requirements
5+ years in Systems, HPC, Distributed Systems, or ML Infrastructure
Hands-on experience with AI inference serving
Strong Python; working knowledge of C++/CUDA
Experience with multi-node GPU clusters and containerized deployments
Benchmark-driven, performance optimization mindset
Ability to work independently with weekly checkpoints
Nice to Have
Quantized inference (FP8/FP4)
KV transfer/cache-tiering projects
Open-source contributions (vLLM, SGLang, etc.)
Bayesian optimization or autotuning experience
What You'll Get
Access to production-grade multi-GPU clusters
Real-world traffic and benchmarking infrastructure
Direct collaboration with the founding team
Rapid decision-making and high-impact engineering work