Job Summary

AI Engineer - Voice AI, LLM Agents Orchestration

We are building a production Voice AI Orchestrator - a system where LLM agents listen, reason, and respond in real time across voice and messaging channels.

As an AI Engineer, you will design and build LLM-powered agent systems, orchestration frameworks, and real-time voice pipelines. This is not a wrapper role - you will own the AI system architecture end-to-end, from agent design and evaluation to production reliability.

We are looking for engineers who have built and shipped AI systems in production, understand the challenges of non-deterministic LLM outputs, and enjoy solving complex real-world engineering problems.

Responsibilities

AI Agents Orchestration

- Design and build multi-agent systems using frameworks like LangGraph and LangChain.

- Implement orchestration workflows with branching logic, retries, and parallel tool calls.

- Build intelligent pipelines with custom tools, memory layers, and dynamic routing.

Voice AI Systems

- Build real-time voice AI pipelines (STT LLM TTS) optimized for low latency.

- Integrate telephony systems via Twilio, WebRTC, and SIP.

- Engineer conversational voice experiences that perform reliably in production.

LLM Reliability Evaluation

- Design LLM evaluation pipelines including regression testing and adversarial evaluation.

- Build guardrails, output validation, and fallback routing for reliable AI behavior.

- Implement observability and monitoring for LLM systems.

Retrieval Knowledge Systems

- Build RAG pipelines for intelligent knowledge retrieval

- Implement hybrid search, re-ranking, and context compression strategies

- Work with vector databases and embedding systems.

Backend System Integration

- Integrate AI systems with Java / Spring Boot backend services

- Implement WebSocket and asynchronous APIs for real-time agent communication.

- Build scalable and reliable system architectures.

Experience

- 2 years of software engineering experience





- Experience building AI or LLM-based applications

- Prior experience deploying LLM agents or AI pipelines into production environments

Agents Framework

Experience with one or more: LangChain / LangGraph / LlamaIndex / CrewAI / Haystack / Semantic Kernel

LLM Engineering

- OpenAI APIs / GPT models

- RAG (Retrieval-Augmented Generation)

- Prompt engineering and context design

- Function calling and structured outputs

- LLM evaluation and reliability techniques

Voice AI

STT / TTS systems/Whisper/Deepgram/ Azure Speech/Google Speech/Real-time voice pipelines/Telephony integration (Twilio, WebRTC, SIP)

Backend

Java Spring Boot WebSockets Async / Multithreading REST APIs

AI Infrastructure

- Vector Databases Embeddings Semantic Search

- Pinecone Qdrant Weaviate Milvus FAISS

Who We Are Looking For

- Engineers who have shipped AI systems to production

- Builders who think in systems - latency, evaluation, reliability

- People who understand that prompt engineering is engineering

- Engineers comfortable working in rapid-moving, ambiguous environments

- Individuals who take full ownership from idea to production

Nice to Have

- Experience with open-source LLMs (Llama, Mistral, Gemma)

- Familiarity with LangSmith, Helicone, or LLM observability tools

- Experience with real-time voice or telephony AI

- Contributions to open-source AI tools

Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

Role: Customer Service,

Industry Type: Emerging Technologies,

Department: Customer Success, Service & Operations,

Employment Type: Full Time, Permanent

Role Category: Customer Success, Service & Operations - Other

Education

UG: Any Graduate

PG: LLM in Law

Key Skills aiai engineerai infrastructureai toolsapisarchitectureasynchronousautomationazurebfsicompressioncrewaiembeddingsfaissfinancial datafintechhyperjavajava spring bootkernellangchainllamallmlow latency

📌 AI Engineer - Voice AI, LLM Agents & Orchestration (Ahmedabad)
🏢 Ignosi Systems
📍 Ahmedabad