Role Overview

We are looking for a QA Engineer to join our AI platform team. The role focuses on validating Model Context Protocol (MCP) servers, AI-powered workflows, and API integrations. The ideal candidate should have robust API testing skills, a positive understanding of Large Language Models (LLMs), prompt engineering concepts, and experience validating AI-based applications.

The candidate will work closely with developers and AI engineers to ensure the correctness of MCP tool execution, API responses, prompt behaviour, and overall system reliability.

Engineering | India | 1-3 Yrs

Where Your Expertise Meets Our Future

- Strong understanding of Software Testing Life Cycle (STLC) and Agile methodologies.
- Hands-on experience in REST API testing.
- Strong knowledge of HTTP methods, REST APIs, JSON, authentication mechanisms, and API debugging.
- Experience using Postman or similar API testing tools.
- Good understanding of test case design techniques and test coverage.
- Basic understanding of AI concepts, especially Large Language Models (LLMs).
- Familiarity with Prompt Engineering concepts and prompt validation.
- Knowledge of Git and defect tracking tools such as Jira.
- Basic scripting knowledge in Python or Java for testing purposes.

Preferred Skills
- Understanding of MCP Server architecture and AI agent workflows.
- Experience validating AI model outputs and prompt quality.
- Familiarity with JSON Schema validation and structured data validation.
- Exposure to API automation frameworks.
- Knowledge of CI/CD tools such as Jenkins or GitHub Actions.




- Basic understanding of cloud platforms such as AWS or Azure.
- Understanding of networking fundamentals, system architecture, and operating systems.
- Familiarity with AI-assisted development tools (e.g., ChatGPT, GitHub Copilot, Claude, Gemini).

Nice to Have
- Experience testing AI agents or Agentic AI systems.
- Understanding of Retrieval-Augmented Generation (RAG), embeddings, and vector databases.
- Experience validating tool-calling workflows, function calling, or AI orchestration frameworks.
- Knowledge of OAuth, authentication flows, and API security testing.
- Exposure to automation frameworks such as Playwright or Selenium.

The Scope of Your Influence
- Design, execute, and maintain test cases for MCP server functionalities.
- Validate MCP tool discovery, tool selection, parameter passing, and response handling.
- Perform API testing using tools like Postman or using Python frameworks.
- Validate AI/LLM workflows, including prompt-response accuracy and business logic.
- Verify tool invocation, parameter validation, response validation, and error handling.
- Perform functional, regression, integration, and end-to-end testing.
- Debug API failures using logs, request/response payloads, and network traces.
- Create and maintain test data, test plans, and defect reports.
- Collaborate with developers, AI engineers, and product teams during feature development.
- Participate in sprint planning, reviews, and Agile ceremonies.
- Contribute towards automation wherever applicable.

📌 Test Engineer (Bengaluru)
🏢 Tally Solutions
📍 Bengaluru