ABOUT XENONSTACK

XenonStack is the fastest-growing Data and AI Foundry for Agentic Systems, enabling enterprises to gain real-time and intelligent business insights.

We deliver innovation through:
- Agentic Systems for AI Agents â akira.ai
- Vision AI Platform â xenonstack.ai
- Inference AI Infrastructure for Agentic Systems â nexastack.ai

Our mission is to accelerate the world’s transition to AI + Human Intelligence by making AI agents reliable, explainable, and enterprise-ready.

THE CHANCE

We are seeking an LLM Reliability & Evaluation Engineer to ensure that large language models (LLMs) and agentic AI systems meet enterprise-grade standards of accuracy, safety, and trustworthiness.

This role focuses on evaluating, benchmarking, and stress-testing LLMs in real-world workflows, building frameworks for reliability, robustness, and continuous improvement. If you thrive at the intersection of AI research, applied testing, and responsible deployment, this is the role for you.

KEY RESPONSIBILITIES
- Evaluation Frameworks




- Design and implement LLM evaluation pipelines covering accuracy, robustness, safety, and bias.
- Develop automated systems for benchmarking models on enterprise-relevant tasks.
- Reliability Engineering
- Conduct stress tests, adversarial testing, and edge-case evaluations.
- Build tools to measure latency, consistency, and error recovery in multi-turn interactions.
- Metrics & Monitoring
- Define KPIs such as factual accuracy, hallucination rate, toxicity, and compliance alignment.
- Establish real-time monitoring for drift, anomalies, and performance regressions.
- Collaboration & Alignment
- Partner with ML engineers, product managers, and domain experts to align evaluation with business objectives.
- Work with Responsible AI teams to implement ethical, explainable, and compliant evaluation practices.
- Continuous Improvement
- Feed insights from evaluation into fine-tuning, RLHF/RLAIF pipelines, and model selection.
- Maintain a centra

📌 LLM Reliability (Sahibzada Ajit Singh Nagar)
🏢 XenonStack
📍 Sahibzada Ajit Singh Nagar