Req ID : 10316588

Job Title: Developer

Work Location: ~INDORE~BHUBANESWAR~BANGALORE~KOLKATA~HYDERABAD~CHENNAI~

Skill Required: Design for GenAI~AI & Gen AI - Products & Tools

Experience Range in Required Skills: 4 to 6

Architect and implement scalable test automation frameworks integrated with GenAI tools.

Generate test cases, test data, and defect analysis using GenAI models (LLMs, RAG, Agentic AI).

Validate GenAI-generated outputs for accuracy, consistency, and completeness.

Embed GenAI-powered test scripts into CI/CD pipelines for continuous testing.

Perform manual testing when needed to validate GenAI-generated artifacts.

Mentor QA teams on GenAI usage patterns, prompt engineering, and automation best practices.

Collaborate with developers and product owners to refine GenAI workflows and fallback logic.

Conduct A/B testing across model versions and prompt designs to optimize output quality.

Evaluate data quality in RAG databases to minimize hallucinations and improve grounding.





6+ years in software QA, with 1+ years in GenAI or LLM-based systems.

Robust understanding of GenAI quality dimensions: grounding, factual correctness, hallucination minimization.

Experience with GenAI tools like Azure OpenAI, AWS Sagemaker, and frameworks like Selenium, Playwright, Python.

Familiarity with XRAY, Jira, and CI/CD tools (Azure DevOps, Jenkins).

Hands-on with prompt engineering, vector DBs, and embedding techniques.

ISTQB CT GenAI or equivalent certification preferred.

Knowledge of domain-specific testing (Insurance, BFSI) is a plus.

Certifications (Preferred)

ISTQB Certified Tester – GenAI CT GEN

Essential Skills

GenAI: Azure OpenAI, AWS Sagemaker, RAG, Agentic AI

Automation: Selenium, Playwright, Python

Test Management: XRAY, Jira

CI/CD: Azure DevOps, Jenkins

Data: JSON, XML, Flat files, Vector DBs

📌 Gen Ai (India)
🏢 Clifyx
📍 India