Job Title: Test Engineer
Position: AI Testing
Experience: 4 - 6 Years
Category: Senior Software Development/ Engineering
Shift: General Shift
Main location: India, Karnataka, Pune
Position ID: J0426-1133
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience.
LI-SK38

Your future duties and responsibilities

Responsibilities:
. Hands-on experience with LLM testing tools such as RAGAs, DeepChecks, OpenAI Evals, or DeepEval is highly desirable.
. Expertise in creating test plans, designing test cases, and executing functional, performance, and regression tests for AI models, focusing on bias, accuracy, and robustness.
. Strong proficiency in Python and frameworks like PyTest for building automated test suites.
. Good experience testing RESTful APIs and backend services to ensure seamless data flow and integration.
. Familiarity with CI/CD pipelines (Jenkins, Kubernetes) and cloud platforms (GCP, AWS) is a major plus.
. A methodical approach to identifying, documenting,



and tracking bugs in complex AI systems.

Required qualifications to be successful in this role

Must-Have Skills:
- Robust experience in Manual & Automation Testing.
- Good knowledge of Python programming.
- Experience with API Testing using Postman/REST Assured.
- Knowledge of Selenium, Pytest, or Robot Framework.
- Understanding of STLC, defect lifecycle, and Agile methodologies.
- Experience in validating AI model outputs, prompts, and response accuracy.
- Exposure to SQL/database testing.
- Experience with Git, CI/CD pipelines, and DevOps practices.
- Strong analytical and debugging skills.
- Good communication and stakeholder management skills.

Good to Have Skills:
- Exposure to Generative AI, LLMs, Chatbots, or Prompt Engineering.
- Experience with cloud platforms like GCP, AWS, or Azure.
- Knowledge of performance testing tools like JMeter.
- Familiarity with Docker/Kubernetes.
- Exposure t

📌 Ai Tester (Pune)
🏢 CGI
📍 Pune