Role - Quality Engineer - AI Chatbot

Location: Bangalore / Mangalore

Work Model: Remote

Employment Type: 4 Month Contract

We are looking for a mid-level Quality Engineer to test AI-powered conversational applications across chat UI, backend APIs, agent workflows and enterprise integrations.

The role will work closely with the QE, AI Developers, Backend Developers and UI Developers to build automated tests, execute regression testing and validate conversational journeys.

Key Responsibilities

- Test end-to-end chatbot and guided user journeys.
- Validate intent routing, conversation context, fallback and escalation flows.
- Test agent tool calls, MCP integrations and backend APIs.
- Validate AI responses for relevance, correctness, groundedness and task completion.
- Create and maintain functional, regression and negative test scenarios.
- Develop automated API and UI tests.
- Test error handling, retries, timeouts and downstream service failures.
- Support prompt and model regression testing using predefined evaluation datasets.
- Validate authentication, authorization, privacy and sensitive-data handling.
- Log defects, analyse failures and support release validation.
- Integrate automated tests into CI/CD pipelines.

Required Skills





- 5 - 8 years of experience in software testing or quality engineering.
- Hands-on experience with API and web application testing.
- Experience with automation tools such as Playwright, Cypress, Selenium or similar.
- Experience with Postman, REST Assured, Python requests or similar API testing tools.
- Programming experience in Python, JavaScript, Java or C#.
- Understanding of REST APIs, JSON, authentication and microservices.
- Experience with SQL and backend data validation.
- Good understanding of functional, integration, regression and end-to-end testing.
- Familiarity with CI/CD, Git and Agile delivery.
- Robust analytical, debugging and communication skills.

Nice to Have

- Experience testing chatbots, LLM applications or conversational AI.
- Understanding of intent routing, prompts, agent workflows and tool calling.
- Exposure to LangGraph, LangChain, MCP, Azure OpenAI or Azure AI Foundry.
- Experience with AI evaluation tools or datasets.
- Exposure to Azure DevOps, Application Insights or Azure Monitor.
- Experience with accessibility, performance, or security testing.

📌 Hiring_Quality Engineer - AI Chatbot__Contract Based role (India)
🏢 Brihati Global Edge Solutions
📍 India