Job Title :
Senior Compiler & Agentic Framework Engineer

Experience:
3–5 Years

Location:
Mumbai (Onsite)

Job Type :
Permanent

Notice Period:
Immediate Joiners Preferred

We're hiring a Senior Compiler & Agentic Framework Engineer to build the execution layer that transforms raw LLM outputs into production-ready software. If you're passionate about compiler technologies, AI infrastructure, and agentic frameworks, this is an prospect to work on cutting-edge AI systems

.

Key Responsibiliti
esBuild Dockerized, isolated execution settings and automated test harnesse
s.Develop grammar-constrained decoding using frameworks such as Outlines or Guidanc
e.Integrate local 26B LLMs with agentic developer frameworks like Aider and custom IDE extension
s.Design and implement evaluation pipelines for multi-language repositories across Java, .NET, Python, Node.js, TypeScript, Bash, COBOL, and
C.Build secure validation and execution pipelines for AI-generated cod




e.Optimize high-performance model inference using vLLM, Triton Inference Server, or llama.cp
p.Collaborate with AI, platform, and engineering teams to deliver scalable developer toolin

g.

Required Ski
llsStrong experience with Compiler Technologies, ASTs, Tree-Sitter, and Runtime Sandboxi
ng.Proficiency in Python and one or more of Java, .NET, TypeScript, Bash, C, or COB
OL.Experience with Docker, containerized execution environments, and automated testi
ng.Hands-on knowledge of vLLM, Triton Inference Server, or llama.c
pp.Experience building AI-powered developer tools, code validation, or execution framewor

ks.

Preferred Sk
illsExperience with Aider, Outlines, Guidance, or similar agentic AI framewo
rks.Familiarity with LLM inference optimization and local model deploym
ent.Knowledge of IDE extensions, code intelligence, or developer productivity platfo

rms.

📌 Senior Compiler Mumbai
🏢 RapidBrains
📍 Mumbai