AI/ML Solution Architect (Bengaluru)

AI/ML Solution Architect (Bengaluru)

22 Oct
|
Deloitte
|
Bengaluru

22 Oct

Deloitte

Bengaluru

Job Description – AI Solution Architect
The Human Capital Offering Portfolio focuses on helping organizations manage and sustain their performance through their most important asset: their people. As we go-to-market, we will show our clients that we serve more than HR organizations – from the CEO to CFO, Risk Manager to Business Unit leader—and that we deliver on our issues and help create value for our clients.
Our Insights, Innovation & Operate Offering is designed to enhance key aspects of our clients' businesses by leveraging cutting-edge technology, data, and a blend of deep technical and human expertise. We innovate and deliver creative, industry-specific solutions that streamline operations and accelerate speed-to-value.
AI Solutions Architect (Senior Consultants, Managers)
We are seeking an AI Solutions Architect to design and deliver production-grade AI agent platforms. The core of this role is building multi-agent orchestration systems using LangGraph and Anthropic Claude—routing user intent to specialized sub-agents, implementing retrieval-augmented generation (RAG) over policy documents, and performing actions. You will own the architecture from LLM prompt design to multi-tenancy and vendor integration across HR platforms (Workday, SAP, Oracle HCM). You will collaborate with engineering, security, and product teams to translate business requirements into production-ready AI agent solutions.
Experience bands:
Senior Consultant: 6+ years total experience, with significant time in AI/ML solution design
Manager: 10+ years total experience, with significant time in AI/ML solution design
Architect RAG pipelines: document ingestion, chunking strategies, embedding generation, vector search (pgvector), hybrid retrieval, and citation-grounded response synthesis.
Evaluate and integrate LLM providers (Anthropic Claude, OpenAI, etc.), defining model selection strategies, prompt engineering standards, and token budget management across agent tiers and multi-tenant data layers
Define end-to-end AI solution architectures from user interaction through agent orchestration, vendor API integration, and production deployment with monitoring.

- own the AI application architecture (agent orchestration, LLM integration, RAG, guardrails, eval frameworks) in joint partnership with the Cloud Solution Architect, who owns the cloud platform and infrastructure layer.
- partner with the Data Integration Architect who owns document ingestion and vector store architecture; own downstream AI application concerns (retrieval strategy, prompt design, response synthesis, evaluation).

Conduct architecture reviews and mentor teams on best practices in LLM application design, agent patterns, and production readiness.
produce HLD/LLD and ADRs.
6+ years (Senior Consultant) or 10+ years (Manager) total experience, with significant time in AI/ML solution design and implementation.
Experience with prompt engineering, tool calling, and LLM evaluation techniques
Expert-level Python development for production systems
Strong hands-on experience building API services with FastAPI
Experience integrating with HR/HCM platforms




Experience with LangFuse, LangSmith, or similar LLM observability and tracing platforms.
Knowledge of responsible AI practices: PII handling, prompt injection defense, model risk management, and explainability.
— working familiarity with cloud-native deployment (Kubernetes, CI/CD, IaC, observability), data engineering patterns (ETL/ELT, lakehouse, streaming), and the operational implications for AI platforms. Not expected to own these, but must collaborate effectively with Cloud Solution and Data Integration architects in joint reviews.
risk, cost vs. Ability to bridge AI research and engineering - turning prototypes into reliable, observable production services.
Coaching and standard-setting across teams.
Job Description – AI Solution Architect
The Human Capital Offering Portfolio focuses on helping organizations manage and sustain their performance through their most important asset: their people. As we go-to-market, we will show our clients that we serve more than HR organizations – from the CEO to CFO, Risk Manager to Business Unit leader—and that we deliver on our issues and help create value for our clients.
Our Insights, Innovation & Operate Offering is designed to enhance key aspects of our clients' businesses by leveraging cutting-edge technology, data, and a blend of deep technical and human expertise. We innovate and deliver creative, industry-specific solutions that streamline operations and accelerate speed-to-value.
AI Solutions Architect (Senior Consultants, Managers)
We are seeking an AI Solutions Architect to design and deliver production-grade AI agent platforms. The core of this role is building multi-agent orchestration systems using LangGraph and Anthropic Claude—routing user intent to specialized sub-agents, implementing retrieval-augmented generation (RAG) over policy documents, and performing actions. You will own the architecture from LLM prompt design to multi-tenancy and vendor integration across HR platforms (Workday, SAP, Oracle HCM). You will collaborate with engineering, security, and product teams to translate business requirements into production-ready AI agent solutions.
Experience bands:
Senior Consultant: 6+ years total experience, with significant time in AI/ML solution design
Manager: 10+ years total experience, with significant time in AI/ML solution design
Architect RAG pipelines: document ingestion, chunking strategies, embedding generation, vector search (pgvector), hybrid retrieval, and citation-grounded response synthesis.
Evaluate and integrate LLM providers (Anthropic Claude, OpenAI, etc.), defining model selection strategies, prompt engineering standards, and token budget management across agent tiers and multi-tenant data layers




Define end-to-end AI solution architectures from user interaction through agent orchestration, vendor API integration, and production deployment with monitoring.

- own the AI application architecture (agent orchestration, LLM integration, RAG, guardrails, eval frameworks) in joint partnership with the Cloud Solution Architect, who owns the cloud platform and infrastructure layer.
- partner with the Data Integration Architect who owns document ingestion and vector store architecture; own downstream AI application concerns (retrieval strategy, prompt design, response synthesis, evaluation).

Conduct architecture reviews and mentor teams on best practices in LLM application design, agent patterns, and production readiness.
produce HLD/LLD and ADRs.
6+ years (Senior Consultant) or 10+ years (Manager) total experience, with significant time in AI/ML solution design and implementation.
Experience with prompt engineering, tool calling, and LLM evaluation techniques
Expert-level Python development for production systems
Strong hands-on experience building API services with FastAPI
Experience integrating with HR/HCM platforms
Experience with LangFuse, LangSmith, or similar LLM observability and tracing platforms.
Knowledge of responsible AI practices: PII handling, prompt injection defense, model risk management, and explainability.
— working familiarity with cloud-native deployment (Kubernetes, CI/CD, IaC, observability), data engineering patterns (ETL/ELT, lakehouse, streaming), and the operational implications for AI platforms. Not expected to own these, but must collaborate effectively with Cloud Solution and Data Integration architects in joint reviews.
risk, cost vs. Ability to bridge AI research and engineering - turning prototypes into reliable, observable production services.
Coaching and standard-setting across teams.
Bachelor's degree in Computer Science, Engineering, Mathematics, or related field (or equivalent practical experience). Deloitte's purpose is to make an impact that matters for our people, clients, and communities. Our purpose comes through in our work with clients that enables impact and value in their organizations, as well as through our own investments, commitments, and actions across areas that help drive positive outcomes for our communities.
It enables us to leverage different ways of thinking, ideas and perspectives, and bring more creativity and innovation to help solve our clients' most complex challenges. This makes Deloitte one of the most rewarding places to work.
Professional development
At Deloitte, professionals have the opportunity to work with some of the best and discover what works best for them. Here, we prioritize qualified growth, offering diverse learning and networking opportunities to help accelerate careers and enhance leadership skills. Benefits To Help You Thrive
Our comprehensive rewards program helps us deliver a distinctly Deloitte experience that helps that empowers our professionals to thrive mentally, physically, and financially—and live their purpose. Recruiting tips
Check out recruiting tips from Deloitte recruiters.

📌 AI/ML Solution Architect (Bengaluru)
🏢 Deloitte
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: ai/ml solution architect (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: ai/ml solution architect (bengaluru) / bengaluru