AI SENIOR ENGINEER — AGENTIC AI & RAG

AGENTIC AI ENGINEERING · A4I (IIIT-B × Microsoft) Organization: A4I (IIIT-B × Microsoft)

Location: IIIT Bangalore

Type: Contract (through March 2027, extendable)

Experience: 5 to 8 years. This band is firm (see Qualifications below).

About A4I

AI Innovation and Inclusion Initiative (A4I) is a partnership between Microsoft and IIIT-B, collaborating with non-profit partners to harness AI for solving real-world challenges in education, healthcare, accessibility, and agriculture. A4I evolves innovations into open-source Digital Public Goods (DPGs) that are deployable at scale, fostering a solid AI innovation ecosystem for social impact.

The Opportunity

At A4I, we build multi-agent AI systems that actually go into production, not demos or a chatbot wrapped around an API. Think millions of students learning in their own language, health workers with no reliable connectivity, and farmers who need answers in real time. That's the scale and the constraints we design for.

Generic AI approaches don't hold up here. We need someone who has actually shipped an agentic system before, someone who writes the code rather than just talking through the architecture in a deck. This is a senior individual-contributor role.

You'll drive the technical decisions on your part of the system, ship code daily, and work closely with a small team of AI engineers, rather than run a practice, manage a team, or set multi-year strategy. Two things worth knowing before you apply. First, this is a software and AI engineering role built on production Python and agent frameworks, not a UI/UX or product design role.

Second, our technical interview covers core computer science fundamentals—data structures, concurrency, database design,



algorithmic complexity—alongside AI/LLM knowledge. Strong AI skills alone won't carry you if the underlying engineering isn't solid.

What You Will Be Doing

Building Agentic Systems

- Design and build multi-agent orchestration pipelines using LangGraph, LlamaIndex, n8n, or equivalent frameworks, for systems with real users and real-world uptime requirements.
- Translate complex, multi-stakeholder social impact use cases into agentic workflows that are resilient, auditable, and deployable in low-resource environments.
- Take a research prototype through to production deployment, writing and owning the code at every stage. Context-Aware AI
- Build and maintain RAG pipelines, vector stores, and graph databases that serve dynamic, multilingual knowledge retrieval at scale.
- Integrate multi-modal inputs (speech, vision, documents) into unified agent workflows.
- Fine-tune and evaluate LLMs (enterprise and OSS) and build evaluation frameworks. Platform and MLOps
- Build AI platform components on Azure, AWS, or GCP with containerized ML pipelines.
- Help establish MLOps practices and monitored production rollouts.
- Propose and follow architectural standards in collaboration with the wider engineering team. Mentorship and Knowledge Sharing
- Pair with and mentor engineers and researchers.
- Communicate technical trade-offs clearly.




- Contribute to open-source projects and documentation.

What You Will Not Be Doing

- Working as a UI/UX or product designer.
- Building isolated ML models that never make it to production.
- Owning multi-year technical strategy or managing a large team.
- Working on generic AI experimentation without clear social impact outcomes.
- Maintaining legacy rule-based or non-AI automation systems.

Must-Have Skills

- Shipped agentic AI in production.
- Agent framework depth (LangGraph, LlamaIndex, n8n, Potpie, or similar).
- Strong LLM and RAG expertise.
- Strong computer science fundamentals.
- Cloud and MLOps fluency.
- Scale and systems thinking.
- Production-quality Python engineering.

Qualifications

- Bachelor's or Master's in Computer Science, Electrical Engineering, Mathematics, or equivalent demonstrated expertise.
- 5 to 8 years designing and building software systems, with a minimum of 2 years focused on AI/ML applications in production.
- Experience band is firm for a senior individual contributor role.
- Verifiable track record of building and shipping AI features or platforms.
- Experience operating in multi-stakeholder environments.

Preferred Qualifications

- Fine-tuning/adaptation of SLMs (Llama, Mistral, Phi) with PEFT/LoRA.
- Experience with VLMs, speech models, multilingual pipelines.
- Azure OpenAI and open-source alternatives.
- Social impact or public sector deployments.
- AI evaluation frameworks (RAGAS, LangSmith).
- Open-source AI contributions. A4I is committed to building AI systems that serve everyone. We actively encourage applications from candidates of all backgrounds, disciplines, and geographies.

📌 AI Senior Engineer — Agentic AI & RAG (Bengaluru)
🏢 AI Innovation and Inclusion Initiative (A4I)
📍 Bengaluru