Manager Generative AI / Agentic AI & MLOps

Job Identification

Field

Details

Job Title

Manager Generative AI / Agentic AI

Function / Department

AI / Data Science

Business Unit

Digital / NBFC / Fintech

Location

Gurugram (Hybrid)

Grade / Level / Band

I1

Reports To

SVP Data Science / AI

Role Type

Hybrid

Employment Type

Full time

Role Purpose

This role is responsible for designing, building, and deploying end-to-end Generative AI and Agentic AI systems, with a strong focus on local LLM deployment, secure enterprise GenAI applications, and scalable MLOps pipelines.

The position requires expertise in:
- Local RAG (Retrieval-Augmented Generation) pipelines
- Agentic AI frameworks (multi-step reasoning systems)
- Private LLM hosting and optimization
- Robust MLOps architecture (Kafka, Kubernetes, Airflow, CI/CD)

Success in this role means delivering production-grade GenAI systems that are scalable, secure, cost-efficient, and deliver measurable business impact.

Key Result Areas & Responsibilities

1. GenAI & Agentic AI Development (35%)




- Design and build end-to-end GenAI applications from scratch
- Develop Agentic AI systems using frameworks like:
- LangChain, LlamaIndex, LangGraph
- AutoGen, CrewAI, Semantic Kernel
- Implement multi-agent workflows for decision-making and automation
- Optimize prompt engineering, memory management, tool usage, and reasoning flows

Outcome: Production-grade GenAI and Agentic AI applications delivering automation and intelligence

2. Local LLM Deployment & Optimization (20%)
- Deploy and manage local/private LLMs (on-prem or VPC environments)
- Work with models such as:
- LLaMA, Mistral, Mixtral, Falcon, Gemma, QWen
- Use inference frameworks:
- vLLM, Ollama, Hugging Face Transformers, TensorRT-LLM
- Optimize for:
- Latency, throughput, and cost
- Quantization and model compression (GGUF, INT4/8)

Outcome: Secure, low-latency, cost-efficient LLM deployments

3. RAG Pipelines & Knowledge Systems (20%)
- Design and impl

📌 Manager - GenAI & ML Ops (Gurugram)
🏢 home credit
📍 Gurugram