Location: Gurugram

Aug 21, 2026

- Job Purpose

The Agentic AI Architect is responsible for defining and delivering the architecture for next-generation AI systems leveraging Large Language Models (LLMs), autonomous agents, and multi-agent orchestration frameworks to enable intelligent automation and advanced digital capabilities.

This role focuses on designing scalable, secure, and production-ready AI platforms that support intelligent decision systems, conversational interfaces, automation workflows, and data-driven operational insights.

The Architect will collaborate closely with AI engineers, data engineers, platform teams, and product stakeholders to build enterprise-grade agentic AI systems aligned with organizational technology strategy, governance standards, and security policies.

- Key Accountabilities

Strategic Activities

- Define enterprise architecture for agentic AI platforms, including multi-agent systems, orchestration frameworks, and LLM-driven applications.
- Design secure Function Calling interfaces and Tool Definition schemas to enable agents to interact with legacy systems, SQL databases, and enterprise CRMs.
- Architect Human-in-the-loop checkpoints and state-management protocols to ensure autonomous actions remain within defined operational guardrails.
- Drive adoption of Generative AI and autonomous agent systems across digital and operational platforms.
- Establish architecture standards for LLM pipelines, prompt engineering, evaluation frameworks, vector search, and Retrieval Augmented Generation (RAG).
- Design scalable AI inference architectures and microservices optimized for latency, cost efficiency, and reliability.
- Define governance frameworks ensuring responsible AI usage, security, explainability, and regulatory compliance.
- Contribute to the AI technology roadmap, including evaluation of new AI platforms, frameworks, and vendor solutions.
- Monitor emerging AI technologies and evaluate their potential impact and opportunities for the organization.
- Balance rapid innovation and experimentation with enterprise-grade reliability and operational stability.

Solution Architecture & Technical Leadership

- Architect end-to-end agentic AI systems including LLM orchestration layers, agent coordination mechanisms, and intelligent workflow automation.
- Design architectures integrating LLM inference services, vector databases, APIs, and enterprise data platforms.
- Define architectural patterns for multi-agent coordination, memory management, tool usage, and reasoning workflows.
- Develop reusable architectural frameworks and design patterns to accelerate AI solution development.
- Evaluate architecture alternatives and define trade-offs between performance, cost, scalability, and security.
- Provide technical guidance to engineering teams implementing AI-driven solutions.
- Ensure architectural alignment with enterprise architecture standards and cloud strategy.

Research & Emerging Technology Monitoring

- Track advancements in LLMs, agent frameworks, orchestration tools, reasoning engines, and AI infrastructure.
- Conduct research and experimentation to evaluate emerging AI technologies and frameworks.
- Develop prototypes and proof-of-concepts to validate architectural approaches.




- Document research findings and architectural guidance for internal knowledge sharing.
- Participate in AI technology communities and industry forums to remain current with evolving AI trends.

Systems & Software Design

- Design software components supporting agent orchestration, AI services, and inference pipelines.
- Produce architecture documentation covering system components, interfaces, and integration patterns.
- Develop multiple architectural views addressing both functional and non-functional requirements.
- Lead architecture and design reviews to ensure adherence to enterprise standards.

AI Platform Engineering & Integration

- Define and implement LLMOps / MLOps practices supporting model evaluation, monitoring, experimentation, and deployment.
- Establish observability frameworks for monitoring model performance, latency, reliability, and cost efficiency.
- Integrate AI services with enterprise applications through APIs, microservices, and data pipelines.
- Ensure production readiness of AI platforms through testing, monitoring, and performance optimization.

Team Leadership & Collaboration

- Provide architectural leadership to AI engineers, LLM engineers, and data engineers.
- Mentor engineering teams on AI architecture patterns, best practices, and design principles.
- Collaborate with product and business teams to translate requirements into scalable AI solutions.
- Support capability building and knowledge sharing across AI and engineering teams.
- Participate in recruitment and development of AI engineering talent.

Any other additional responsibility could be assigned to the role holder from time to time as a standalone project or regular work. The same would be suitably represented in the Primary responsibilities and agreed between the incumbent, reporting officer and HR.

- Skills Required for the Role

AI & Machine Learning

- Strong expertise in machine learning, generative AI, and large language models
- Experience designing LLM-based applications and agentic AI systems
- Hands-on experience with LangGraph, CrewAI, Autogen, or Semantic Kernel for multi-agent coordination.
- Experience in designing State Management and persistent memory systems (e.g., Zep, Mem0) for long-running autonomous tasks.
- Knowledge of prompt engineering, embeddings, vector databases, and RAG architectures
- Familiarity with AI orchestration frameworks and autonomous workflow design
- Experience implementing AI evaluation and monitoring frameworks

Programming & Engineering

- Strong programming skills in Python
- Experience with ML frameworks such as PyTorch, TensorFlow, or Keras
- Experience with data processing libraries (NumPy, Pandas, Scikit-learn)
- Ability to design scalable microservices and distributed systems
- Experience developing APIs and integration services

Cloud & AI Infrastructure





- Experience deploying AI solutions on cloud platforms (AWS, Azure, or GCP)
- Familiarity with containerization and orchestration (Docker, Kubernetes)
- Knowledge of vector databases, data pipelines, and AI infrastructure
- Experience with LLMOps / MLOps platforms

Architecture & System Design

- Expertise in distributed systems architecture
- Strong understanding of scalability, reliability, and performance engineering
- Ability to design enterprise-grade AI platforms and frameworks

Leadership & Communication

- Strong technical leadership and mentoring capabilities
- Excellent analytical and problem-solving skills
- Ability to communicate complex AI concepts to both technical and non-technical stakeholders
- Robust documentation and architecture communication skills

D. Educational and Experience Requirements

Minimum Education Requirements

Master's degree in computer science, AI/ML, or related field OR bachelor's degree

15+ years of total work ex

10+ years' experience in distributed systems/ML

Minimum Requirement

Desired

Experience

- 8+ years in software architecture or ML engineering
- 3+ years hands-on experience with LLMs and generative AI
- Proven track record designing production AI systems at scale
- Experience with agent frameworks (LangGraph, CrewAI, Autogen, etc.)

- 10+ years in AI/ML systems architecture
- Experience in highly regulated industries (finance, healthcare, aviation)
- Prior experience with autonomous systems or robotics
- Published research or open-source contributions in agentic AI

Certifications

- AWS Certified Machine Learning - Specialty

- Azure AI Engineer Associate

#innershell { max-width: 1600px; } #search-wrapper, .back-to-search-wrapper, .jobTitle, #similar-jobs { display: none !important; } .jobDisplayShell { width: 100%; max-width: 100%; margin-top: 30px; } .jobDisplay { width: 100%; min-width: 100%; background: white; padding-bottom: 40px; } .jobDisplay .joblayouttoken:nth-child(2) { padding-left: 10px !important; } .jobDisplay .job { padding-left: 35px; } .jobDisplay .joblayouttoken:nth-child(2), .jobDisplay .joblayouttoken:nth-child(4) { min-width: 100px; float: left; padding: 20px 10px !important; background: #F0F5F7; } .jobDisplay .customPlugin-1108346adb9b9abd { min-width: 5px; float: left; padding: 20px 0px !important; background: #F0F5F7; } .jobDisplay .joblayouttoken:nth-child(2) span, .jobDisplay .joblayouttoken:nth-child(4) span, .jobDisplay .customPlugin-1108346adb9b9abd .inner { font-weight: bold; } .joblayouttoken .inner { max-width: 100% !important; } .joblayouttoken .inner div { padding-left: 0 !important; } .jobdescription h2 { font-size: 20px !important; color: #1F2B34 !important; margin-bottom: 10px !important; font-weight: 600; } .joblayouttoken h1 span { font-weight: bold; color: #1F2B34 !important; font-size: 24px !important; } .applylink { float: none !important; margin-left: 35px !key; text-align: left; margin-top: 15px; } .applylink a { text-transform: uppercase; padding: 5px 30px; } @media(max-width: 980px) { .jobDisplay { padding: 0 20px; } .applylink { margin-left: 0px !important; margin-bottom: 20px !important; } } @media(max-width: 767px) { .jobDisplay .joblayouttoken:nth-child(2) { margin-left: 0px !important; } }

📌 Agentic AI Architect (Gurugram)
🏢 Air India
📍 Gurugram