Senior Manager RAG/LLM Specialist

Experience: 47 Years

Function: Generative AI / Machine Learning / LLM

Employment Type: Full-time

Role Overview

We are looking for a Senior Manager RAG/LLM Specialist to lead the design, optimization, and enterprise deployment of advanced Retrieval-Augmented Generation (RAG) solutions and LLM-based applications.

The ideal candidate will have strong hands-on experience in RAG pipelines, LLM fine-tuning, embeddings, vector databases, prompt engineering, and GenAI evaluation frameworks, with the ability to take solutions from prototype to production at enterprise scale.

Key Responsibilities

- Design and manage complex, multi-stage RAG pipelines focused on high relevance, accuracy, scalability, and low latency.
- Lead LLM fine-tuning initiatives using PEFT, LoRA/QLoRA, and other parameter-productive techniques.
- Work with open-source foundation models to improve domain-specific performance.
- Design advanced retrieval strategies including hybrid search, semantic search, metadata filtering, reranking, HyDE, and parent-document retrieval.
- Develop automated evaluation frameworks using tools such as RAGAS to measure context precision, context recall, response quality, and overall LLM performance.
- Architect and optimize vector database solutions using technologies such as Pinecone, Milvus, FAISS, Weaviate, or Qdrant.
- Lead prompt engineering and optimization initiatives across GenAI use cases.
- Work closely with data, engineering, and product teams to productionize LLM solutions.




- Mentor junior team members on RAG architecture, chunking strategies, prompt engineering, evaluation, and code quality.
- Drive best practices around LLM application development, observability, testing, and performance optimization.

Required Skills

- 47 years of experience in AI/ML, Data Science, NLP, or Software Engineering, with at least 1+ year of hands-on LLM/GenAI experience.
- Strong programming skills in Python.
- Hands-on experience with RAG / Retrieval-Augmented Generation.
- Strong knowledge of LangChain and/or LlamaIndex.
- Experience with advanced embedding models and vector search.
- Strong understanding of prompt engineering and prompt optimization.
- Hands-on experience with LLM fine-tuning, PEFT, LoRA/QLoRA.
- Experience with PyTorch and/or TensorFlow.
- Experience with vector databases such as Pinecone, Milvus, FAISS, Weaviate, Qdrant, Chroma, Elasticsearch/OpenSearch.
- Knowledge of RAG evaluation and RAGAS.
- Exposure to OpenAI, Anthropic, Hugging Face, or other LLM platforms/APIs.

Good to Have

- Experience with HyDE, parent-document retrieval, reranking, hybrid search, query expansion, and contextual retrieval.
- Experience deploying LLM applications in production.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Knowledge of LLM observability and evaluation tools.
- Experience mentoring engineers or leading GenAI initiatives.

Interested Candidates can directly share their profile to [email protected]

📌 RAG/LLM Specialist_ Manager/Sr. Manager (Bengaluru)
🏢 EXL
📍 Bengaluru