Job Title - AI Architecture Manager | S&C; GN

Management Level: 07 - Manager

Location: PAN India

Must Have Skills: Enterprise AI Architecture, LLM Orchestration, Agentic AI Frameworks, MLOps, API Design &

- Integration, AI Governance &
- Responsible AI, Solution Architecture for AI Transformation, LangChain / LlamaIndex, RAG Architecture, Vector Databases, Team Management

Good to Have Skills:Kubernetes / Docker, Feature Stores, Model Registry &

- Experiment Tracking (MLflow / W&B;), Event-driven Architecture (Kafka / Pub/Sub), TOGAF / ArchiMate

Job Summary

As an AI Architecture Manager, you will be responsible for designing and governing the architectural blueprints that enable large-scale AI transformation across enterprise environments. Your typical day will involve defining how AI components — including LLMs, agents, ML models, and data pipelines — are structured, coordinated, and deployed across the enterprise. You will lead a team of AI and data engineers, engage with senior client stakeholders to shape AI strategy and platform roadmaps, and establish the reusable patterns, standards, and governance frameworks that ensure AI systems are scalable, reliable, secure, and responsible.

You will operate platform-agnostically, designing architectures that work across cloud and hybrid environments.

Roles &

- Responsibilities:

- Define and own enterprise AI architecture blueprints — covering LLM integration, agentic systems, ML pipelines, data flows, and API layers across the enterprise.
- Design reusable AI architecture patterns and reference architectures that standardize how AI components are built, deployed,



and governed at scale.
- Lead the architectural design of LLM orchestration layers, including prompt management, context handling, tool use, and multi-agent coordination.
- Establish MLOps frameworks covering model training, versioning, deployment, monitoring, and retraining pipelines across cloud and on-premise environments.
- Define API design standards and integration patterns for AI services, ensuring interoperability across enterprise systems and third-party platforms.
- Embed AI governance, responsible AI principles, and risk management frameworks into architectural design decisions.
- Manage and mentor a team of AI and data engineers, fostering a culture of architectural rigour and technical innovation.
- Engage with C-level and senior client stakeholders to translate enterprise AI transformation objectives into executable architecture roadmaps.
- Evaluate and recommend AI tooling, platforms, and frameworks — balancing build vs. buy decisions with long-term scalability and vendor independence.
- Collaborate with data, security, and infrastructure teams to ensure AI architectures are production-ready, compliant, and cost-efficient.

Professional &

- Technical Skills:

- Must Have Skills:



Deep expertise in Enterprise AI Architecture, LLM orchestration, agentic AI frameworks, MLOps, API design & integration, and AI governance; with a proven track record of leading AI architecture initiatives in enterprise transformation programmes.
- Strong ability to design end-to-end AI system architectures — spanning data ingestion, model serving, agent orchestration, and API exposure.
- Deep understanding of LLM orchestration patterns — chaining, tool use, memory, multi-agent systems, and context window management.
- Hands-on experience establishing MLOps practices —
- CI/CD for ML, model registries, experiment tracking, monitoring, and drift detection.
- Proficiency in API design principles (REST, GraphQL, async patterns) and integration architecture for AI services.
- Experience embedding responsible AI and governance frameworks — bias detection, explainability, audit trails, and compliance controls.
- Ability to design platform-agnostic architectures deployable across major cloud providers (AWS, GCP, Azure) and hybrid environments.
- Solid leadership and communication skills, with experience presenting AI architecture strategies to executive and non-technical audiences.

Additional Information

- The ideal candidate will bring a rare combination of deep AI engineering expertise and enterprise architecture leadership, with a demonstrated ability to design scalable, governed AI systems that accelerate transformation at an enterprise level.
- This position is based at all PAN India offices.

About Our Company | Accenture

📌 #ACN I&P - GN - SONG - AI & Data - Marketing - MMM NBA - Manager (Bengaluru)
🏢 Accenture in India
📍 Bengaluru