15 Nov
|
BMW TechWorks India
|
Pune
15 Nov
BMW TechWorks India
Pune
Required Experience, minimum: 5 years
Required Experience, maximum: 8 years
Minimum Qualification: BCA
B.Tech/B.E
- BSc
Role Senior Quality & AI Evaluation Engineer (Senior)
Visit our website bmwtechworks.in to know more.
About the UNIT/ Unit Overview
AIRE (AI-native Requirements Engineering) is a new BMW Group tool for managing vehicle requirements, the descriptions of what a car and its software must do. It keeps the full history of every requirement, shows how requirements are linked to each other and to tests, and shows what is affected when something changes. It helps teams meet automotive standards such as Automotive SPICE and ISO 26262.
AIRE is built for AI agents first and a user interface later, and the team uses AI agents to help build it. In this role you make sure AIRE and its AI features work correctly, through automated tests and checks.
Location
Pune or Bangalore
Experience
Number of openings
1
What awaits you/ Job Profile
- Define and maintain the test and evaluation strategy, including test levels, quality gates and evidence.
- Automate BDD scenarios from the acceptance criteria, contract tests and property-based tests.
- Run load tests against the quality goals and report the results.
- Build and run evaluations for agents and AI functions together with the Lead Agentic Engineering & AI Platform Engineer.
- Produce test evidence for tool qualification together with the Functional Safety & Process Compliance Specialist.
- Act as the human approver for changes to test oracles,
evaluation datasets and quality-gate thresholds.
- Set up automated quality gates (tests, coverage, static analysis, performance and security tests) from the very beginning, and keep them mandatory for every change.
What should you bring along
- Degree in Computer Science or a related field, or equivalent relevant experience.
- Minimum of five years of test or quality engineering experience.
- Demonstrated experience automating tests for data-intensive systems.
Must have technical skill
- Robust test engineering experience in Python (for example pytest), including test automation in CI/CD.
- Experience with BDD (for example Gherkin, behave or pytest-bdd) and contract testing.
- Experience with property-based testing (for example Hypothesis) for complex data logic.
- Experience with load and performance testing (for example k6 or Locust) against defined service-level objectives.
- Experience evaluating LLM-based systems and agents with golden datasets, regression evaluations and acceptance thresholds.
- Proficient AI-native engineering practice, including using agents to generate tests while keeping test oracles and evaluation criteria under human control.
Good to have technical skills
- Knowledge of ISO 26262 Part 8 tool qualification and of test evidence for Automotive SPICE.
- Experience with mutation testing and test-quality metrics.
- Experience with observability-based testing (for example OpenTelemetry).
- ISTQB certification.
📌 Senior Quality & AI Evaluation Engineer (AIRE) (Pune)
🏢 BMW TechWorks India
📍 Pune