Home
Careers
Senior AI / LLM Engineer

All open roles

Engineering

Senior AI / LLM Engineer

Full-time

Bengaluru / Remote

4–8 years experience

Build production LLM systems, RAG pipelines, and agentic workflows that actually ship.

About The Role

We're looking for a Senior AI/LLM Engineer to design and operate intelligent systems in production. You'll work across the full lifecycle - from architecture and evaluation harnesses to deployment and monitoring. This isn't a research role. You'll be building AI systems that run real workflows for real clients, and you'll own the outcome.

What you'll do

Design and implement production RAG systems, LLM pipelines, and multi-agent workflows
Build evaluation frameworks to measure accuracy, hallucination rate, and latency before every deployment
Set up LLMOps infrastructure - logging, monitoring, cost tracking, and model versioning
Work directly with clients to translate business requirements into AI architectures
Conduct code reviews, define engineering standards, and mentor junior engineers




Own end-to-end delivery from architecture to production handover

What we're looking for

4+ years of software engineering experience with 2+ years in production ML or LLM systems
Strong Python skills and experience with LangChain, LlamaIndex, or similar frameworks
Hands-on experience with vector databases (Pinecone, Weaviate, Qdrant, pgvector)
Experience building and evaluating RAG pipelines at production scale
Familiarity with OpenAI, Anthropic, Cohere, or open-source LLM APIs
Solid understanding of prompt engineering, context management, and retrieval strategies
Experience with cloud infrastructure (AWS, GCP, or Azure) and containerisation (Docker, Kubernetes)

Nice to have

Not required

Experience with multi-agent frameworks (AutoGen, CrewAI, LangGraph)
Familiarity with LLMOps tools (Langfuse, Helicone, Phoenix, W&B; Weave)
Prior consulting or client-facing project delivery experience
Contributions to open-source AI tooling

What

📌 Senior AI (Bengaluru)
🏢 Thinkscoop Technologies
📍 Bengaluru