About Level AI
Level AI is a Series C conversational intelligence company headquartered in Mountain View, CA, backed by top-tier VCs and Silicon Valley operators. We help enterprise contact centers understand every customer conversation — using speech AI, NLP/NLU, and retrieval systems to turn millions of unstructured interactions into decisions businesses can act on.
Why this role exists
We're at the scaling inflection point. The systems that carried us from Series A to Series C won't carry us to the next stage, and we need someone to own that transition — not just build inside it.
This is a Principal role: you'll set technical direction for backend and ML infrastructure across multiple teams, make the architectural calls that are expensive to reverse, and raise the engineering bar through design reviews, mentorship, and the standards you set by example. You'll report to the VP of Engineering and partner directly with our ML, Product, and Infrastructure leads across both sites.
You'll work alongside engineers from Amazon, Google,
and Meta who chose to build here because the problems are unsolved and the ownership is real.
What you'll do
Own the architecture for real-time data processing at scale. Design and evolve distributed messaging systems that handle high-throughput streaming workloads with strict latency requirements.
Build the ML platform that lets us ship models faster. Define and execute the technical roadmap for training and serving infrastructure as our models grow in size, complexity, and inference cost.
Scale our GPU infrastructure. Own capacity planning, scheduling, and utilization across training and inference fleets — deciding what runs where, how we handle burst demand, and how we keep spend tied to actual throughput rather than idle reservations.
Scale inference. Drive down latency and cost per request as model complexity and traffic grow: batching and routing strategies, quantization and compilation, autoscaling, and caching — without degradin