Experience Level: 8-10 Years

Location: Bangalore/ Gurgaon/Hyderabad

Employment Type: Full-Time

About The Role

We are seeking an experienced and visionary Senior Software Engineer - AI/ML with 8-10 years of robust software engineering and specialized artificial intelligence/machine learning background. In this role, you will architect, build, and scale advanced AI systems, agentic frameworks, and generative AI solutions. You will work at the cutting edge of modern AI technology-bridging traditional software engineering excellence with state-of-the-art LLMs, multi-agent systems, and robust cloud architectures.

Key Responsibilities

• Design & Architecture: Architect, develop, and scale end-to-end AI/ML and Generative AI applications from proof-of-concept to production.
• Agentic Frameworks & LLM Integration: Design and implement sophisticated agentic workflows, autonomous systems, and LLM-driven applications using LangChain, LangGraph, and LangSmith.
• Model Evaluation & Security: Implement rigorous LLM evaluation pipelines (including "LLM-as-a-Judge" patterns),



ensuring model safety, data privacy, and robust AI security guardrails.
• Data Infrastructure: Leverage and optimize graph databases and vector databases for high-performance semantic search, retrieval-augmented generation (RAG), and knowledge graphs.
• Observability & Monitoring: Establish end-to-end observability, tracing, and monitoring for LLM applications using tools like Arize AI.
• API & Systems Design: Build secure, high-throughput, and scalable APIs, incorporating Model Context Protocol (MCP) and Agent-to-Agent (A2A) communication patterns.
• Collaboration & Leadership: Mentor junior engineers, drive technical decisions across teams, and collaborate closely with product managers and data scientists.

Required Qualifications & Technical Skills

• Experience: 8 to 10 years of professional software engineering experience, with a heavy emphasis on Machine Learning, Deep Learning, and Generative AI sy

📌 Senior Software Engineering Lead (Hyderabad)
🏢 Optum India
📍 Hyderabad