Position: AI Tester

Experience: 2 - 8 Years

Location: Kolkata (Onsite)

Employment Type: Full-Time

About the Role

We are looking for a skilled and detail-oriented AI Tester to join our Quality Engineering team. The ideal candidate should have hands-on experience in testing AI/ML and Generative AI (GenAI) applications, with expertise in validating model behavior, prompt engineering, API testing, automation, and performance testing. You will play a key role in ensuring the quality, reliability, fairness, and performance of AI-powered solutions.

Key Responsibilities

- Design, develop, and execute test strategies for AI/ML and Generative AI applications.
- Perform functional and non-functional testing to ensure application quality and reliability.
- Validate Large Language Model (LLM) responses through prompt testing and prompt validation.
- Conduct AI model evaluation by assessing accuracy, consistency, robustness, and reliability.
- Perform bias, hallucination, toxicity, and fairness testing to ensure responsible AI practices.
- Validate AI quality metrics such as precision, recall, accuracy, latency, and response relevance.
- Develop and maintain automation test frameworks for AI-driven applications.
- Perform API testing using tools such as Postman, REST Assured, or similar frameworks.
- Execute performance, load, and scalability testing for AI services and APIs.
- Identify, document, track, and verify defects throughout the software development lifecycle.
- Collaborate closely with AI Engineers, Data Scientists, Developers,



and Product Teams to ensure high-quality AI solutions.
- Contribute to continuous improvement of AI testing methodologies, processes, and automation.

Required Skills
- 2-8 years of experience in Software Testing, including experience testing AI/ML or Generative AI applications.
- Hands-on experience in functional and non-functional testing.
- Experience with prompt testing, prompt validation, and LLM response evaluation.
- Solid understanding of AI model evaluation techniques and quality assessment.
- Knowledge of AI quality metrics, bias detection, hallucination testing, fairness, and responsible AI validation.
- Experience in API testing using REST APIs and related tools.
- Experience with automation testing frameworks (Selenium, Playwright, Cypress, or similar).
- Experience in performance testing using tools such as JMeter, LoadRunner, or equivalent.
- Good understanding of software testing methodologies, defect lifecycle, and Agile practices.
- Strong analytical, troubleshooting, and communication skills.

Preferred Qualifications
- Exposure to AI/ML frameworks and LLM-based applications.
- Familiarity with Python or Java for automation scripting.
- Experience working with cloud-based AI platforms (Azure AI, AWS AI, or Google Cloud AI) is an added advantage.
- ISTQB certification or equivalent testing certification is preferred.

Education
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

📌 AI Tester - Kolkata Location
🏢 Tuteck
📍 Kolkata