Job Title: Test Engineer
Position: AI Testing
Experience: 4 - 6 Years
Category: Senior Software Development/ Engineering
Shift: General Shift
Main location: India, Karnataka, Pune
Position ID: J0426-1133
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.
LI-SK38

Your future duties and responsibilities

Responsibilities:
. Hands-on experience with LLM testing tools such as RAGAs, DeepChecks, OpenAI Evals, or DeepEval is highly desirable.
. Expertise in creating test plans, designing test cases, and executing functional, performance, and regression tests for AI models, focusing on bias, accuracy, and robustness.
. Robust proficiency in Python and frameworks like PyTest for building automated test suites.
. Good experience testing RESTful APIs and backend services to ensure seamless data flow and integration.
. Familiarity with CI/CD pipelines (Jenkins, Kubernetes) and cloud platforms (GCP, AWS) is a major plus.
. A methodical approach to identifying,



documenting, and tracking bugs in complex AI systems.

Required qualifications to be successful in this role

Must-Have Skills:
Robust experience in Manual & Automation Testing.
Good knowledge of Python programming.
Experience with API Testing using Postman/REST Assured.
Knowledge of Selenium, Pytest, or Robot Framework.
Understanding of STLC, defect lifecycle, and Agile methodologies.
Experience in validating AI model outputs, prompts, and response accuracy.
Exposure to SQL/database testing.
Experience with Git, CI/CD pipelines, and DevOps practices.
Strong analytical and debugging skills.
Good communication and stakeholder management skills.

Valuable to Have Skills:
Exposure to Generative AI, LLMs, Chatbots, or Prompt Engineering.
Experience with cloud platforms like GCP, AWS, or Azure.
Knowledge of performance testing tools like JMeter.
Familiarity with Docker/Kubernetes.
Exposure t

📌 Ai Tester Pune (India)
🏢 CGI
📍 India