AI Engineer, Incident Intelligence Platform

We are looking for an AI Engineer with strong hands-on skills in LLM systems and retrieval-augmented generation to join our incident intelligence team. In this role, you will architect and operate the full pipeline that powers our AI-driven root cause analysis (RCA) platform, from the vector database and retrieval layer through to Claude prompt engineering, structured output validation, and confidence scoring and intelligent routing. You will build the systems that decide whether an RCA is accurate enough to auto-notify an on-call engineer or needs human review, working across our multi-tenant PaaS platform hosting 100+ enterprise customer workloads on shared AWS EKS.

Qualifications:
4+ years of experience in AI/ML engineering, data engineering, NLP, or a closely related field, including hands-on LLM work.
Production experience building and operating a vector database (pgvector, Pinecone, Weaviate, or equivalent).
Strong understanding of embedding models and how embedding quality affects retrieval accuracy.




Experience designing and operating data ingestion pipelines at scale (Celery, Airflow, or similar).
Demonstrated experience prompt engineering for production LLM systems requiring reliable structured outputs, not just chatbots or demos.
Experience building LLM evaluation frameworks, including golden test sets, judge prompts, and accuracy metrics.
Robust Python skills, including FastAPI, Pydantic, SQLAlchemy, and async patterns.
Clear understanding of how RAG context affects LLM reasoning and how to diagnose retrieval-driven errors.
Familiarity with semantic search concepts: cosine similarity, approximate nearest neighbor, and hybrid search.
Production experience with the Claude API (messages format, system prompts, structured output patterns) is a plus.
Experience with LLM output validation frameworks such as Pydantic or Guardrails is a plus.
Understanding of confidence calibration techniques (ECE, Platt scaling, temp

📌 Senior AI Engineer – RAG (Bengaluru)
🏢 FICO
📍 Bengaluru