Test Automation Engineer

Company: Nxtjob.ai

Location: Bangalore Hybrid

Employment Type: Full-time

Experience: 2+ years

Compensation: 913 LPA CTC, based on experience

Reports To: Engineering Lead

About the Role

Nxtjob.ai currently ships to production with zero automated test coverage. As our first Test Automation Engineer, you will build the quality and automation foundation for our AI-native stack across the frontend, backend, and model outputs.

This is a from-zero opportunity where you will own what gets automated, how it integrates with CI, and how we ensure both application logic and AI behaviour remain reliable.

What You'll Own

Build the Safety Net from Zero

- Build automated unit, integration, smoke, and regression test suites across the Next.js frontend and Node.js backend.
- Establish test automation from scratch.
- Integrate automated testing into CI/CD so broken builds are identified before production.
- Prioritize and automate the core user and business flows that matter most.

Test the Model, Not Just the Code
- Build automated test cases for LLM agent outputs.
- Use Langfuse traces and evaluation frameworks to identify regressions in prompt and model behaviour.
- Define clear pass/fail criteria for AI output quality.




- Convert recurring production failures into permanent regression tests in collaboration with support and QA.

Make Quality Everyone's Responsibility
- Document test coverage, gaps, and quality risks clearly for the engineering team.
- Embed automated testing into the team's daily development workflow rather than treating QA as a separate final phase.

What You Bring
- 2+ years of hands-on experience building test automation for frontend and backend applications.
- Strong experience with automation frameworks such as Playwright, Cypress, or Selenium.
- Experience with API testing.
- Working knowledge of CI/CD and integrating automated tests into development pipelines.
- Comfortable with, or eager to quickly learn, testing LLM-based systems, including prompt evaluation and output consistency.
- Exposure to tools such as Langfuse is a plus.
- Strong ability to prioritize high-impact automation in a from-zero setting.
- Experience building test suites rather than primarily executing manual test cases.

Why This Role? This is the opportunity to build the test automation and quality foundation Nxtjob.ai has never had — for both application code and AI model behaviour.

📌 Test Automation Engineer (Bengaluru)
🏢 Nxtjob.ai
📍 Bengaluru