Position: AI Engineer Copilot Studio & Azure AI Foundry
Location: Pune
Experience: 3+ Years
Notice Period: 0–30 Days
Role Overview
As an AI Engineer, you will design, build, and operate intelligent agentic workflows and agents using Microsoft Copilot Studio and Azure AI Foundry. You will integrate LLMs with enterprise data, implement secure and reliable AI agents, and continuously improve quality through evaluation, tracing, and structured experimentation.
Key Responsibilities
1. Agent & Workflow Engineering
- Design, implement, and ship conversational and agent workflows.
- Implement RAG with vector/hybrid retrieval and integrate enterprise data sources.
- Use tool calling/actions and publish agents to chat and web with proper authentication.
- Apply software engineering best practices.
2. Prompting, Quality & LLMOps
- Design prompts, system messages, and agent behaviors for robustness and reliability.
- Run structured Prompt flow experiments and evaluations.
- Perform tracing, A/B testing, and error analysis.
3. Data, Integrations & RAG Pipelines
- Connect agents to enterprise sources such as SharePoint, Microsoft Graph, and Azure Blob.
- Build ingestion, chunking, and embedding pipelines.
- Use Azure AI Search for vector/hybrid retrieval when required.
- Develop clean, versioned API integrations.
4. Security, Compliance & Governance
- Enforce least-privilege access, secrets hygiene, and managed identities.
- Apply content-safety guardrails, prompt-injection resilience, and input/output filtering.
- Follow environment strategies and DLP policies aligned with enterprise governance.
5. Operations, Cost & Observability
- Monitor runtime using logs, metrics, and distributed tracing.
- Maintain dashboards and define and track KPIs such as cost per successful task and task-success rate.
- Apply resilience patterns including retries, timeouts, circuit breakers, and rate limits.
Required Skills
- Solid hands-on AI experience is mandatory.
- Hands-on experience
📌 AI Engineer Copilot Studio (Pune)
🏢 Experis
📍 Pune