We are looking for a QA Engineer / Software Tester with knowledge of Generative AI and Agentic AI to join our team and help test an Agentic AI framework.

Key Responsibilities

- Test Agentic AI applications and AI-driven workflows.
- Validate complete agent workflows: User Request → Planning → Tool Selection → Execution → Final Response.
- Test LLM-based applications for accuracy, relevance, consistency, and hallucinations.
- Validate tool/function calling, including API parameters, responses, failures, and retries.
- Test multi-agent workflows and communication between agents.
- Test RAG (Retrieval-Augmented Generation) workflows and knowledge retrieval.
- Validate agent memory and context handling.
- Perform API testing using Postman or similar tools.
- Perform database testing and backend data validation using MySQL.
- Write and execute complex SQL queries to validate application and AI-agent data.
- Verify database transactions, relationships, constraints, stored data, and data integrity.
- Perform functional, integration, regression, negative, and edge-case testing.
- Test failure scenarios such as API timeout, incorrect tool response, missing data, and invalid input.
- Perform basic prompt injection and AI security/guardrail testing.
- Analyze agent execution logs and identify the root cause of failures.
- Create and maintain test cases, test scenarios, bug reports, and QA documentation.
- Work closely with AI/ML and development teams to improve overall agent reliability.

Required Skills:
- Strong knowledge of Software Testing / QA fundamentals.
- Experience with Manual Testing and API Testing.
- Strong knowledge of MySQL and database testing is mandatory.
- Strong SQL skills, including JOINs,



subqueries, GROUP BY, aggregate functions, data validation, and troubleshooting database-related issues.
- Good understanding of database relationships, primary/foreign keys, constraints, transactions, and data integrity.
- Good understanding of REST APIs, JSON, and Postman.
- Understanding of Generative AI, LLMs, prompts, tokens, context, and hallucinations.
- Understanding of Agentic AI concepts and agent workflows.
- Knowledge of AI agents, tool/function calling, planning, execution, and memory.
- Basic understanding of RAG and vector databases.
- Ability to design test cases for non-deterministic AI outputs.
- Strong analytical, debugging, and problem-solving skills.

Good to Have
- Python knowledge and test automation experience.
- Selenium, Playwright, PyTest, or similar automation tools.
- Experience with LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, or similar agent frameworks.
- Knowledge of AI evaluation techniques such as groundedness, relevance, faithfulness, and response quality.
- Experience with Azure/AWS/GCP and AI services.
- Git, CI/CD, and Docker knowledge.
- Experience testing multi-agent or AI orchestration systems.

Experience: 0- 2+ years of Software Testing / QA experience preferred.

Candidates should have strong QA fundamentals, strong MySQL/database knowledge, and an understanding of Generative AI and Agentic AI systems.

Job Type: Full time

Key Skills

Software Testing, QA, Agentic AI, Generative AI, LLM, RAG, MySQL, SQL, Database Testing, API Testing, Postman, Prompt Testing, AI Testing, Function Calling, Tool Calling, Python, Test Automation

Pay: ₹117,594.76 - ₹244,260.61 per year

Work Location: In person

📌 QA Engineer / Software Tester – Agentic AI (Pune)
🏢 TGC Technologies
📍 Pune