AI Engineer

Experience: 3–4 years

Location: Bengaluru, India

About ivoyant:

ivoyant is a software engineering and product company headquartered in Atlanta, USA, with delivery teams in the US and India. We build integration, case management and AI-enabled applications for clients in the public sector, healthcare, logistics and other industries. Our Bengaluru team works directly with US-based architects and client teams on product development and client delivery.

Job Summary:

We are looking for an AI Engineer with 3–4 years of software development experience, including hands-on work building applications on Large Language Models (LLMs). The role focuses on building AI agents and LLM-powered features, the harnesses that run and test them, and the monitoring that shows how they perform in production.

The engineer will work with US-based architects and our product and delivery teams to take AI features from prototype to production.

Key Responsibilities:

- Build AI agents that plan tasks, call tools and APIs, and work with business data.
- Build and maintain agent harnesses: tool definitions, context and memory handling, guardrails, retries and test runs.
- Integrate LLMs (OpenAI, Anthropic, Azure OpenAI or open-source models) into applications through their APIs.
- Build retrieval-augmented generation (RAG)



features using vector databases.
- Write and refine prompts, and build evaluation sets to measure output quality.
- Add monitoring to AI features: logs, traces and metrics for response quality, latency, errors and token cost.
- Deploy and support AI services in production on Azure or AWS.
- Keep up with current models, frameworks and tools, and try them out on real use cases.

Required Qualifications & Skills:

- Bachelor's or Master's degree in Computer Science, Engineering or a related field.
- 3–4 years of software development experience, with at least 1–2 years building LLM-based applications.
- Strong Python, including building REST APIs (for example, FastAPI or Flask).
- Hands-on experience with LLM APIs, prompt engineering and RAG.
- Experience with at least one agent framework or SDK, such as LangGraph, LangChain, LlamaIndex, OpenAI Agents SDK or Claude Agent SDK.
- Working knowledge of monitoring and telemetry: structured logging, tracing and metrics (for example, OpenTelemetry, Langfuse or LangSmith).
- Familiarity with SQL, Git, Docker and Azure or AWS.

Good to Have:

- Experience with Model Context Protocol (MCP) servers or multi-agent setups.
- Experience with document processing or data extraction using LLMs.

📌 AI Engineer (Bengaluru)
🏢 Ivoyant
📍 Bengaluru