Job Description

Job Title: AI QA Engineer

Locations: Hyderabad, India | Hybrid

Get To Know Us:

As a leading financial services and healthcare technology company based on revenue, SS&C; is headquartered in

Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare

organizations, from the world's largest companies to small and mid-market firms, rely on SS&C; for expertise, scale, and

technology.

What You Will Get to Do:

Develop automated testing framework suites designed to validate non-deterministic model outputs, agent

decision paths, and safety compliance.

Perform systematic bias, hallucination, and boundary testing across multi-agent graph applications.

Curate robust edge-case validation datasets using actual operational logs and synthetic test data.

Implement specialized AI testing frameworks (Ragas, Deep Eval, Promptfoo) to quantify response relevance,

context grounding, and accuracy.

Execute automated regression tests whenever prompt configurations, vector store indexes, or underlying

model versions update.

Log execution failures, detail misrouting issues, and work directly with graph engineers to fix logical gaps.

What You Will Bring:

4–7 years in Software Quality Assurance, with at least 2 years focused on testing AI, ML, or data-intensive

applications.





Robust Python coding ability for writing test scripts, custom assertions, and integrating test suites into CI/CD

workflows.

Direct experience using open-source or commercial AI evaluation frameworks (Ragas, Deep Eval, Promptfoo,

Lang Smith).

Thorough grasp of core software testing methodologies adapted for non-deterministic software execution.

Hands-on experience with REST API testing, PyTest frameworks, JSON structure validation, and Git workflows.

Why You Will Love It Here!

Flexibility: Hybrid Work Model and Business Casual Dress Code, including jeans

Your Future: Provident Fund

Work/Life Balance: Flexible Personal/Vacation Time Off, Sick Leave, Paid Holidays

Your Wellbeing: Mediclaim, Term Life Insurance, Accidental Coverage, Employee Assistance Program,

Parental Leave

Diversity & Inclusion: Committed to Welcoming, Celebrating and Thriving on Diversity

Training: Hands-On, Team-Customized, including SS&C; University

Extra Perks: Diwali voucher, Monthly remunerated RnR program

We encourage applications from people of all backgrounds to enable us to bring diverse perspectives to our thinking

and conversation. It is important to us that we strive to have a workforce that is diverse in the widest sense.

📌 Senior AI QA Engineer - Pre-Req Approval ID:INDA (India)
🏢 SS&C Technologies Holdings
📍 India