Position Description
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: AI QA Engineer
Position: Senior Software Engineer
Experience: 5+ Years
Category: Software Development / Quality Engineering
Main Location: HYD/BAN/CHE
Position ID: J1026-0677
Employment Type: Full Time
Position Description:
We are looking for an experienced AI QA Engineer with solid expertise in Python-based test automation, API testing, data validation,
and AI/ML model evaluation. The ideal candidate will have hands-on experience testing Generative AI (GenAI) and Large Language Model (LLM) applications, including Retrieval-Augmented Generation (RAG) systems. The role involves evaluating prompt and response quality, validating groundedness, identifying hallucinations, performing Responsible AI and security testing, and ensuring performance and reliability. Experience with cloud AI platforms such as Azure AI Foundry, Azure OpenAI, and Azure Machine Learning is essential.
Your future duties and responsibilities
• Design, develop, and maintain automated test frameworks using Python.
• Perform API testing and data validation to ensure accuracy, consistency, and reliability.
• Evaluate AI/ML models for functional accuracy, performance, and reliability.
• Test Generative AI and LLM-based applications, including RAG pipelines.
• Evaluate prompt effec
📌 AI QA Engineer (Bengaluru)
🏢 CGI
📍 Bengaluru