Job Details:

- Company: 86 Agency
- Position: Software Development Engineer – AI
- Experience: 3+ Years (Mandatory)
- Location: Hyderabad
- Work Mode: Hybrid

About the Role

We are hiring a Software Development Engineer - AI to build production-grade AI applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic AI frameworks. The role involves developing intelligent workflows, integrating enterprise data sources, and building reliable, secure, scalable AI services with an emphasis on accuracy, traceability, and performance

What You Will Build

- LLM Applications & AI Services: LLM-powered applications, prompt workflows, structured outputs, and function calling.
- Agentic AI & Orchestration: AI agents, tool integrations, and multi-step workflow automation.
- RAG & Knowledge Retrieval: Document ingestion, embeddings, vector databases, semantic search, and contextual retrieval.
- AI Evaluation & Guardrails: Response validation, hallucination mitigation, quality evaluation, and monitoring.
- Enterprise AI Integration: AI-powered document processing, information extraction, summarization, and report generation.
- AI Governance & Traceability: Citations, source attribution, audit logging, and secure data handling.

Key Responsibilities

- Develop and maintain AI applications using LLMs, RAG, and agentic AI frameworks.
- Build AI agents capable of executing multi-step tasks and interacting with APIs, tools, and enterprise systems.
- Implement document ingestion, parsing, chunking, embedding, and retrieval pipelines.
- Develop prompt templates, structured outputs, function calling, and context management mechanisms.
- Integrate LLM services with backend APIs, databases, and enterprise data sources.
- Implement AI evaluation pipelines to measure accuracy,



relevance, faithfulness, latency, and cost.
- Develop guardrails for hallucination mitigation, prompt injection protection, and sensitive data handling.
- Build AI-powered document analysis, extraction, summarization, and content generation workflows.
- Implement citations, source traceability, logging, and validation of AI-generated outputs.
- Optimize AI workflows for performance, scalability, token usage, and cost efficiency.
- Write clean, testable, maintainable Python code and contribute to code reviews, testing, and deployments.
- Collaborate with senior engineers, platform teams, and product stakeholders to deliver production-ready AI capabilities.

Required Qualifications

- 3+ years of software development experience, with practical experience building AI/LLM-based applications.
- Solid Python programming skills and experience building backend services or REST APIs.
- Hands-on experience with LLM APIs such as OpenAI, Azure OpenAI, Anthropic, or open-source models.
- Experience implementing RAG pipelines, embeddings, and vector search (e.g., FAISS, pgvector, Pinecone, or

Qdrant).
- Familiarity with LangChain, LangGraph, LlamaIndex, Semantic Kernel, or equivalent implementations.
- Understanding of prompt engineering, function calling, structured outputs, and AI application testing.

Working knowledge of Git, Docker, CI/CD, databases, and cloud deployment fundamentals.

Preferred Qualifications

- Experience with multi-agent workflows, MCP, or enterprise tool integration.
- Familiarity with LLM evaluation and observability tools such as LangSmith, Langfuse, or Arize Phoenix.
- Experience in document intelligence, OCR, or unstructured data processing.
- Understanding of RBAC, data privacy, auditability, and regulated enterprise environments.

📌 Software Development Engineer – AI (Gurugram)
🏢 86 Agency
📍 Gurugram