Home/Jobs/AI Infrastructure Architect

AI Infrastructure Architect

Accenture

Pune

3-5 years

Today

$20.5K–32.5K/yr

Full time

Onsite

Skills Required LLM

RAG

LangChain

Agentic AI

Azure OpenAI

Microsoft Azure OpenAI Service

GPT-5.0

LangGraph

Python

FastAPI

REST

Azure AI services

AI Foundry

CI/CD

Description We are looking for a skilled Agentic AI Developer to build, integrate, and optimize intelligent agent solutions using Azure OpenAI and related frameworks. The role works closely with architects and senior team members to deliver scalable AI applications.

Role: AI Infrastructure Architect

Location: Pune | Multiple locations

Experience

- Experience: 2-5 years
- Minimum 3 years of experience in Microsoft Azure OpenAI Service

Qualification

- 15 years full time education

Responsibilities

- Architect and build custom AI infrastructure/hardware solutions
- Optimize AI infrastructure/hardware performance, power consumption, cost, and scalability
- Advise on AI infrastructure technology and vendor evaluation, selection, and full stack integration
- Develop intelligent agents using LangChain, LangGraph, and Azure OpenAI services
- Implement agent workflows, tool integrations, and multi-step reasoning pipelines
- Build and maintain stateful agent flows using LangGraph constructs
- Contribute to RAG pipelines, prompt templates, and reusable components
- Collaborate with senior developers and architects to implement agentic AI solution designs
- Translate functional requirements into working AI agent modules and workflows
- Support enhancements and feature development for existing agentic solutions
- Work on prompt engineering, response tuning, and workflow improvements
- Assist in optimizing performance, latency, and response quality of LLM-based applications




- Implement basic memory handling and context management in agents
- Integrate AI agents with enterprise systems, APIs, and data sources
- Support deployment of solutions on Azure cloud environments
- Work with DevOps teams for build, deployment, and monitoring support
- Follow best practices for Responsible AI, security, and data privacy
- Participate in testing, debugging, and validation of AI solutions
- Ensure adherence to coding standards and enterprise guidelines
- Work closely with cross-functional teams including QA, Dev, BA, and DevOps
- Actively upskill on Agentic AI frameworks, LLM advancements, and Azure AI services
- Contribute to documentation and knowledge sharing

Additional Responsibilities

- Project Role: AI Infrastructure Architect
- Project Role Description: Architect and build custom AI infrastructure/hardware solutions
- Optimize computational stack performance, power consumption, cost, and scalability

More Skills GPT-5.0 or higher, Multi-agent orchestration, Prompt engineering, Vector databases, LLM evaluation, LLM tuning, CI/CD pipelines, Cloud deployments, Logging, Monitoring tools

Prepare for this role

Recommended resources to build the skills for this position. Sponsored.

Top 50 RAG Interview Questions

Zenaique

Curated RAG interview questions and answers from Zenaique.

Top 50 AI Agent Interview Questions

Zenaique

Curated AI agent interview questions from Zenaique.

Top 100 Agentic AI Interview Questions

Zenaique An extended AI agent interview question set from Zenaique.

More LLM jobs

Senior Developer- Snowflake Cortex AI

Cognizant

United States

Today

Lead Agentic Software Engineer II

Deloitte

Hermitage

Today

AI Engineer

Cornerstone OnDemand

Hyderabad

Today

Opening For GenAI- Python

Cognizant

Chennai

Today

Senior Software Engineer

Cyient

Noida

Today

Agentic Solutions-AI

Deloitte

Bengaluru

Today

📌 AI Infrastructure Architect (Pune)
🏢 Top Gen AI Jobs
📍 Pune