Company Name: VARITE India Private Limited

About The Client:

Client is one of the world’s leading professional services firms and the fastest growing Big Four accounting firm

About The Job:
- We’re building the next-generation multi-agentic system that powers intelligent, adaptive, and scalable chatbot experiences. As a Senior LLM Engineer , you'll be a core member of our team, designing and deploying production-ready systems built on foundation models. You’ll contribute across the LLM development lifecycle—from prompt engineering and fine-tuning to orchestration and LLMOps.
- We're AWS-native and leverage GitLab for CI/CD and infrastructure automation. You’ll work closely with ML researchers, DevOps engineers, and product teams to operationalize advanced AI capabilities

Essential Job Functions:
- LLM System Development
- Design, build, and optimize multi-agent LLM architectures for chatbot orchestration.
- Engineer advanced prompt chains, retrieval-augmented generation (RAG), and agent memory systems.
- Integrate multiple LLMs (e.g., OpenAI, Anthropic) and tools (e.g.,



vector DBs, external APIs, code execution etc) into a cohesive agentic pipeline.
- LLMOps & Deployment
- Build and maintain LLMOps workflows using GitLab pipelines and Terraform/CloudFormation on AWS.
- Monitor, test, and evaluate LLM performance in production; define guardrails, fallback strategies, and observability metrics.
- Collaboration & Leadership
- Mentor junior engineers; review code and model pipelines.
- Collaborate with cross-functional stakeholders to translate product needs into LLM-driven solutions.
- Stay ahead of LLM research trends and translate insights into practical engineering designs.

Qualifications:

Required:
- 4-8 years in software or machine learning engineering, with 2+ years focused on LLMs or NLP systems.
- Experience working in product workplace and familiarity with Agile.
- Deep experience with prompt engineering, LLM APIs, LangGraph/LangChain/LlamaIndex, and v

📌 Senior AI Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru