Job Description: Manager – Generative AI / Agentic AI & MLOps
Location : Gurugram - On Site
Reports To : SVP – Data Science / AI
Role Purpose :
This role is responsible for designing, building, and deploying end-to-end Generative AI and Agentic AI systems, with a robust focus on local LLM deployment, secure enterprise Gen AI applications, and scalable MLOps pipelines.
The position requires expertise in:
Local RAG (Retrieval-Augmented Generation) pipelines Agentic AI frameworks (multi-step reasoning systems)Private LLM hosting and optimization Robust MLOps architecture (Kafka, Kubernetes, Airflow, CI/CD )
Success in this role means delivering production-grade Gen AI systems that are scalable, secure, cost-efficient, and deliver measurable business impact.
Key Result Areas & Responsibilities :
Gen AI & Agentic AI Development (35%)
Design and build end-to-end Gen AI applications from scratch
Develop Agentic AI systems using frameworks like:
Lang Chain, Llama Index, Lang Graph
Auto Gen, Crew AI, Semantic Kernel
Implement multi-agent workflows for decision-making and automation




Optimize prompt engineering, memory management, tool usage, and reasoning flows
Outcome: Production-grade Gen AI and Agentic AI applications delivering automation and intelligence
2. Local LLM Deployment & Optimization (20%)
Deploy and manage local/private LLMs (on-prem or VPC environments)
Work with models suchas:
LLa MA, Mistral, Mixtral, Falcon, Gemma, Qwen
Use inference framewoks: v LLM, Ollama, Hugging Face Transformers, Tensor RT-LLM
Optimize for:
Latency, throughput, and cost
Quantization and model compression (GGUF, INT 4/8)
Outcome: Secure, low-latency, cost-efficient LLM deployments
3. RAG Pipelines & Knowledge Systems (20%)
Design and implement advanced RAG pipelines:
Document ingestion, chunking, embedding, retrieval, re-ranking, Grounding
Build local knowledge bases using:
Vector DBs: FAISS, Chroma, Weaviate, Pinecone (optional hybrid), Qdrant
Implement:
Hybrid search (BM25 + vector)

📌 Manager (Faridabad)
🏢 Home Credit India
📍 Faridabad