About Us

Straive is a global leader in data analytics and AI operationalization, helping enterprises embed advanced AI and data capabilities into core business workflows to deliver measurable business outcomes and ROI. With a workforce of ~20,000 professionals serving 350+ clients across 30+ markets, Straive combines technical scale with deep domain expertise. A key differentiator is its network of over 6,000 subject matter experts who specialize in managing and enriching complex, unstructured data enabling organizations to build AI systems grounded in accuracy, context, and business relevance.

The company continues to earn recognition from leading industry analysts and was recently named a Leader in AIM’s 2026 Generative AI and Data Engineering PeMa Quadrants. Backed by EQT a purpose-driven global investment organization which was ranked among the world’s leading private equity firms by PEI in 2025 Straive is positioned as a high-value alternative to traditional IT services providers, combining domain-led intelligence with AI execution at scale.

As a GenAI Test Lead, you will define and operationalize quality for AI systems, bridging traditional QA with AI engineering. You will design scalable evaluation frameworks (EvalOps) to measure groundedness, factual accuracy, coherence, and RAG performance, ensuring our AI systems are reliable, aligned, and production-ready. This role requires treating LLM outputs as measurable signals—building data-driven validation systems that continuously improve model performance and user experience.

Key responsibilities and duties –





Define evaluation metrics for LLM systems (groundedness, hallucination rate, task success RAG accuracy)

Design and implement automated EvalOps pipelines for continuous model validation

Establish acceptance criteria and quality benchmarks for AI releases

Build scalable test frameworks for LLM-based systems using tools like DeepEval, pytest, or custom pipelines

Automate validation of prompts, responses, and agent workflows

Integrate AI testing into CI/CD pipelines

Analyze LLM outputs as structured data to identify failure patterns

Validate data quality, retrieval accuracy, and grounding in RAG systems

Design synthetic and real-world test datasets

Collaborate with AI engineers, product teams, and clients to define quality standards

Drive alignment across distributed/onshore-offshore teams

Provide insights on model performance and improvement areas

Evaluate prompt strategies, agent behaviors, and user interaction flows

Ensure outputs align with business context and user expectations

Rapidly adapt to domain-specific requirements

Experience with Rational Tool Suite, JIRA, or similar test management tools.





Experience in using/setting up continuous integration testing and experience with any DevOps tools

Develop automation tests as part of the Eval Framework using frameworks like DeepEval, pytest etc

Solid understanding of Agile principles; experience in SAFe Agile environments.

Experience testing APIs and data integrations.

Experience working in an onshore/offshore model.

Experience in test automation design and execution.

Strong understanding of different software testing methodologies.

Required Qualifications and Experience –

Minimum 6+ years of overall experience in software QA.

Education: Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related quantitative field.

Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot complex, distributed AI systems.

Communication: Excellent communication skills to articulate technical findings and development progress effectively.

Recognition & Achievements

We have been recognized as a Star Performer in Data & AI Services Specialists - Everest’s North America PEAK Matrix 2025, and as a Leader in AIM’s Pema Quadrant of Agentic AI Service Providers - 2025.

In Nov 2023, Straive acquired Gramener, an award-winning, design-led data science company, enhancing our data, analytics, and AI capabilities. In June 2025, we acquired SG Analytics, a leading provider of AI-powered insights and contextual analytics services.

For more information, please visit our ?Website https://www.straive.com/

📌 Senior Software Engineer (Chennai)
🏢 Us Straive
📍 Chennai