– Quality Engineer (AI & Conversational Applications)

Experience: 5–8 Years

Location-Remote

Employment Type: Contract

Role Overview

We are looking for a skilled Quality Engineer with experience in testing AI-powered conversational applications, web applications, APIs, and enterprise integrations. The ideal candidate will work closely with AI Engineers, Backend Developers, UI Developers, and Quality Engineering teams to ensure the quality, reliability, and performance of AI-driven chatbot and agent-based solutions.

Key Responsibilities
Design and execute end-to-end test scenarios for AI-powered chatbots and conversational applications.
Validate conversational flows, intent routing, context retention, fallback mechanisms, and escalation paths.
Test backend APIs, agent tool calls, MCP integrations, and enterprise services.
Verify AI-generated responses for accuracy, relevance, groundedness, and task completion.
Develop and maintain functional, regression, integration, negative, and end-to-end test cases.
Build and maintain UI and API automation test suites.
Validate error handling, retries, timeouts, and downstream service failures.
Support prompt and model regression testing using predefined evaluation datasets.
Test authentication,



authorization, privacy, and sensitive data handling.
Log defects, analyze failures, support release validation, and integrate automated tests into CI/CD pipelines.

Required Skills & Qualifications
5–8 years of experience in Software Testing or Quality Engineering.
Hands-on experience with API and Web Application Testing.
Experience with Playwright, Cypress, Selenium, or similar automation tools.
Experience with Postman, REST Assured, Python Requests, or similar API testing tools.
Programming experience in Python, JavaScript, Java, or C#.
Understanding of REST APIs, JSON, Authentication, Microservices, SQL, CI/CD, Git, and Agile.
Robust analytical, debugging, and communication skills.

Preferred Skills
Experience testing Chatbots, LLM applications, or Conversational AI.
Knowledge of Intent Routing, Prompt Engineering, Agent Workflows, and Tool Calling.
Exposure to LangGraph, LangChain, MCP, Azure OpenAI, Azure AI Foundry.
Experience with AI evaluation tools/datasets.
Exposure to Azure DevOps, Azure Monitor, and Application Insights.
Knowledge of Accessibility, Performance, and Security Testing.

📌 Quality Engineer Ai & Conversational Applications 5–8 Years Contract Role Bangalore Metropolitan Area
🏢 Brihati Global Edge Solutions
📍 Bangalore Metropolitan Area