Quality Assurance Analyst (Gen AI and RAG) (Hyderabad)

Quality Assurance Analyst (Gen AI and RAG) (Hyderabad)

07 Oct
|
Infor
|
Hyderabad

07 Oct

Infor

Hyderabad

Description

As a Quality Assurance Analyst at Infor, you will have a critical role in ensuring the delivery of high-quality enterprise applications that meet the evolving needs of our global customers. You’ll collaborate closely with developers, product managers, and customer success teams to validate functionality, performance, and scalability—helping us deliver smarter, faster, and more intuitive software.

A Typical Day in the Life Includes:

- Design and execute test cases for AI Studio's Orchestrator Agent — verifying that the correct components are selected, the right questions are asked, and assumptions are applied accurately for a given user input.
- Validate gap map outputs — confirming that fields are correctly classified as confirmed, assumed, auto-resolved, or missing based on schema contracts and domain defaults.
- Test schema and knowledge document submissions through the Content API — verifying structure validation, field type enforcement, controlled vocabulary checks, and embedding generation.
- Execute search relevance tests across all six OpenSearch indices — verifying that queries return the expected documents with acceptable relevance scores.
- Test multi-agent task packet assembly — confirming that confirmed values, assumed values, upstream context, and output contracts are correctly populated before specialist agents are invoked.
- Verify execution tier ordering — ensuring components with blocking dependencies are never dispatched before their upstream dependencies have completed.
- Perform tenant isolation testing — confirming that session data, project history, and search results are strictly scoped to the correct tenant across all operations.
- Analyse audit logs and search traces to identify the root cause of failures in the multi-agent pipeline and report findings with clear reproduction steps.

Basic Qualifications:

- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field. 3–5 years of experience in software quality assurance.
- Solid understanding of REST API testing and hands-on experience with tools such as Postman, REST Assured, or equivalent.
- Experience writing automated test scripts in Python — ability to build repeatable test cases for API-level and integration-level scenarios.
- Familiarity with search systems — understanding of how relevance scoring works and the ability to design queries that validate expected search behaviour.
- Ability to define acceptability criteria for non-deterministic outputs — understanding that LLM-driven responses require semantic evaluation rather than exact-match assertions.




- Experience with integration testing across multi-service or distributed architectures — ability to trace a failure across service boundaries to its root cause.
- Strong analytical skills and attention to detail — particularly important when validating structured JSON outputs such as task packets, gap maps, and deployment blueprints.
- Positive written communication skills — ability to write clear, reproducible bug reports and test documentation.

Preferred Qualifications:

- Exposure to RAG systems, vector search, or LLM-driven applications — either through professional experience or personal projects.
- Familiarity with OpenSearch, Elasticsearch, or similar search platforms.
- Exposure to LLM evaluation tools such as RAGAS, DeepEval, or equivalent frameworks for assessing AI output quality.
- Experience with multi-tenant SaaS testing — particularly data isolation and session boundary validation.
- Familiarity with CI/CD pipelines and the ability to integrate automated test suites into deployment workflows.
- Knowledge of JSON Schema validation and the ability to write schema-level assertions against complex nested JSON structures.
- Exposure to Infor OS, ERP systems, or enterprise workflow automation products.
- Experience designing synthetic test data for knowledge-driven systems where the quality of test documents directly affects the coverage and reliability of test results.

About Infor

About Infor

Infor is where ambition meets impact. Join a global community of bold thinkers and innovators, where your expertise doesn't just solve problems. it shapes industries, unlocks opportunities, and creates real-world impact for billions of people. At Infor, you're not just building a career. you're helping to build what's next.

Infor is a global leader in business cloud software products for companies in industry specific markets. Infor builds complete industry suites in the cloud and efficiently deploys technology that puts the user experience first, leverages data science, and integrates easily into existing systems. Over 60,000 organizations worldwide rely on Infor to help overcome market disruptions and achieve business-wide digital transformation.

For more information visit www.infor.com

About Infor

Infor is where ambition meets impact.



Join a global community of bold thinkers and innovators, where your expertise doesn't just solve problems. it shapes industries, unlocks opportunities, and creates real-world impact for billions of people. At Infor, you're not just building a career. you're helping to build what's next.

Infor is a global leader in business cloud software products for companies in industry specific markets. Infor builds complete industry suites in the cloud and efficiently deploys technology that puts the user experience first, leverages data science, and integrates easily into existing systems. Over 60,000 organizations worldwide rely on Infor to help overcome market disruptions and achieve business-wide digital transformation.

For more information visit www.infor.com

Our Values

At Infor, we strive for an environment that is founded on a business philosophy called Principle Based Management™ (PBM™) and eight Guiding Principles: integrity, stewardship & compliance, transformation, principled entrepreneurship, knowledge, humility, respect, self-actualization.

We have a relentless commitment to a culture based on PBM™. Informed by the principles that allow a free and open society to flourish, PBM™ prepares individuals to innovate, improve, and transform while fostering a healthy, growing organization that creates long-term value for its clients and supporters and fulfillment for its employees.

Infor is an Equal Opportunity Employer. We are committed to creating a diverse and inclusive work environment. Infor does not discriminate against candidates or employees because of their sex, race, gender identity, age, sexual orientation, religion, national origin, veteran status, or any other protected status under the law. If you require accommodation or assistance at any time during the application or selection processes, please submit a request by following the directions located in the FAQ section.

Fraud Awareness

We have been made aware of unauthorized individuals posing as Infor recruiters, including some who have made fraudulent offers of employment. Please read our guidelines and protect yourself from recruitment scams.

Fraud Privacy Policy

We value your privacy at Infor. You may access our privacy policy here.

US Only
This employer uses E-Verify. Please visit this website for additional information.

E-Verify Illinois: Click here, aquí, or tu

Click the links below for additional information:

- Right to Work

- Employee Polygraph Protection Act
- Family & Medical Leave Act
- Discrimination & Harassment Policy
- Equal Employment Opportunity

📌 Quality Assurance Analyst (Gen AI and RAG) (Hyderabad)
🏢 Infor
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: quality assurance analyst (gen ai and rag) (hyderabad) / hyderabad

Subscribe to this job alert:

Get the latest job offers by email for: quality assurance analyst (gen ai and rag) (hyderabad) / hyderabad