13 Nov
|
Uplers
|
Bengaluru
Experience: 3.00 years
Salary: Confidential (based on experience)
Expected Notice Period: 30 Days
Shift: (GMT 05:30) Asia/Kolkata (IST)
Opportunity Type: Hybrid ()
Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Tailored AI)
(*Note: This is a requirement for one of Uplers client - Tailored AI)
What do you need for this chance
Must have skills required
CI/CD and automated test pipelines, Freshdesk), Ticketing tools (Jira, Zendesk, Python (Pytest), Playwright / Selenium, Testing AI / LLM applications, Large Language Model APIs (LLM APIs), LLM, API, Docker
Tailored AI is Looking for:
Support / QA Engineer
We're hiring a hands-on Support / QA Engineer for AI Platform. You'll QA, validate, and evaluate technical deliverables under the guidance of the Engineering Lead. You'll also own platform support — triaging, troubleshooting, and replicating bugs while coordinating directly with platform engineering.
Experience: 3–5 years
- Location: Bengaluru
Responsibilities
- QA and validate technical deliverables before they reach customers, under the guidance of the Eng Lead.
- Write and run test plans, test cases, and regression suites — manual and automated.
- Evaluate deliverables against requirements and report gaps clearly.
- Test the platform's AI features from an AI point of view — accuracy, hallucinations, consistency across runs, edge-case and adversarial prompts, and safety of responses.
- Build and maintain evaluation datasets and test cases for AI outputs, and track AI quality across releases.
- Handle platform support — triage incoming issues, troubleshoot, and replicate bugs.
- Coordinate directly with platform engineering — raise clear bug reports with repro steps, logs, and impact, and track them to closure.
- Maintain support docs,
known issues, and troubleshooting runbooks.
Skills
Must have
- QA fundamentals — test planning, test case design, regression and release testing
- Test automation with Python (Pytest) or tools like Playwright / Selenium
- Testing AI / LLM applications — evaluating output quality, hallucinations, prompt edge
- cases, and non-deterministic behaviour
- Building eval datasets and using LLM evaluation approaches (golden sets, rubric- based or LLM-as-judge scoring)
- API testing — REST, Postman or similar
- Debugging — reading logs, Linux CLI, basic SQL
- Working knowledge of Docker and Kubernetes to set up and reproduce environments
- Structured triage — can isolate a problem and reproduce it reliably
- Clear written communication — bug reports engineers can act on
Good to have
- Support experience on an enterprise / B2B platform
- Ticketing tools (Jira, Zendesk, Freshdesk)
- CI/CD and automated test pipelines
How to apply for this opportunity
- Step 1: Click On Apply! And Register or Login on our portal.
- Step 2: Complete the Screening Form & Upload updated Resume
- Step 3: Increase your chances to get shortlisted & meet the client for the Interview!
About Uplers
Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement.
(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).
So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!
📌 QA Engineer (Bengaluru)
🏢 Uplers
📍 Bengaluru