QA Engineer – AI & Prompt Engineering

Location: Remote

Employment: Full-time, OpsXpress(India)

Client: Emmacare (USA)

Experience Level: 4 – 5 Years

Salary: No bar for top-tier talent.

Job Type: Full time

About the Role

OpsXpress is seeking a QA Engineer (Manual Testing) to join the core engineering team at Emmacare, a leading US-based SaaS platform specializing in Chronic Care Management (CCM) and Telehealth.

We are looking for an experienced Manual QA Engineer with 4 to 5 years of experience with deep core QA expertise and specialized experience in evaluating AI features and Prompt Engineering.

In this role, half of your focus will be grounded in rigorous, deep-dive manual testing across complex web/mobile platforms. The remainder will focus on stress-testing LLMs, refining prompt structures, and driving standard QA practices across non-deterministic software systems.

Key Responsibilities

Manual Quality Assurance (50%)

· Perform deep, hands-on Exploratory, Functional, Integration, Regression, and Smoke testing across web and mobile platforms.

· Execute thorough API testing (using Postman, Insomnia, or Curl) to validate backend logic, payload structures, status codes, and edge-case handling.

· Uncover complex system bugs, race conditions, state management issues, and cross-browser/platform UI flaws.

· Author clear, detailed, and reproducible bug reports with log traces, network captures, and clear acceptance criteria.

Conduct end-to-end user journey validations across multi-system integrated workflows.

AI & Prompt Testing (30%)

· Evaluate LLM and Generative AI outputs for accuracy, hallucinations, bias, tone, and context adherence.





· Perform systematic Prompt Engineering and Prompt Testing to optimize prompt templates, system instructions, and dynamic variables.

· Create and manage test datasets for continuous model evaluation and semantic correctness.

QA Processes & Metrics (20%)

· Establish standardized manual testing processes tailored for non-deterministic AI applications.

· Define and track key evaluation metrics for AI quality (e.g., relevance, faithfulness, coherence, response latency, refusal accuracy).

· Participate in Agile ceremonies (Sprint Planning, Grooming, Retrospectives) representing Quality Assurance.

Required Qualifications & Skills

Core QA Expertise

· 4–5 years of hands-on manual QA experience in commercial web and/or mobile applications.

· Strong knowledge of software fundamentals, architectural flow, client-server communication, and web protocols.

· Proficiency in API testing (Postman, REST APIs, JSON/XML payload validation).

· Advanced defect-logging skills and mastery of test management tools (Jira, TestRail, Qase).

· Deep understanding of STLC, exploratory testing strategies, and risk-based testing approaches.

AI & Prompt Engineering Expertise

· Proven experience evaluating AI/LLM-powered features (e.g., OpenAI, Anthropic, Gemini, open-source models).

· Hands-on experience writing, tuning, and testing structured prompts (few-shot, chain-of-thought, system prompts).

· Familiarity with common AI vulnerabilities (Prompt Injection, Hallucinations, Data Poisoning, System Instructions Leakage).

Nice-to-Have Skills

· Basic Python scripting knowledge for data manipulation or simple API test scripts.

· Understanding of data privacy and safety considerations in AI systems.

📌 QA Engineer AI & Prompt Engineering (India)
🏢 OpsXpress
📍 India