You will own quality across Energy.AI, from API and UI automation to the harder problem of testing AI systems whose outputs are not deterministic. You will define the test strategy, build the automation framework and integrate it into delivery pipelines.
Key responsibilities :
- Define and maintain the test strategy across UI, API, data and AI components.
- Build and maintain Python-based test automation frameworks from scratch where needed.
- Automate API, UI and end-to-end tests and integrate them into CI/CD quality gates.
- Design test approaches for LLM, RAG and agent features, working with data scientists on evaluation sets.
- Plan and support system integration testing and user acceptance testing with client users.
- Manage defects, test reporting and traceability to requirements.
- Mentor QA engineers and set code-review standards for test code.
Required experience and skills :
- 5+ years in software testing with at least 3 years in test automation.
- Solid Python test automation (pytest, Requests, Selenium or Playwright).
- API testing experience (Postman, REST, OAuth2 / OpenID).
- Experience integrating tests into CI/CD (Azure Pipelines, GitLab CI, Jenkins).
- Experience designing test automation architecture and strategy.
- Experience in Agile teams using Azure DevOps or Jira.
Preferred / nice to have :
- Experience testing AI or LLM-based applications.
- Performance and load testing tools.
- Java test automation experience.
- Azure Test Plans and Docker-based test environments.