What you will work on

Our Vertical Search team's mission is to deliver the best TV search experience: rapid, comprehensive, and reliably relevant. For REA Vertical Search, that means helping users discover the right content across typed, voice, and assistant-driven experiences while supporting a growing set of subscription services and Roku Channel discovery surfaces. We partner with search engineers, ML engineers, product managers, and data partners to define quality strategy for relevance-sensitive experiences, build scalable automation and evaluation frameworks, and apply agentic automation to keep pace with expanding catalog breadth and use cases.

Role Overview

We are looking for a Lead, Search Relevance Quality to work closely with the Roku Vertical Search Team to define, measure, and improve Search and Assistant relevance quality. This person will lead quality strategy for relevance-sensitive experiences, build scalable automation and evaluation frameworks, and apply agentic automation to keep pace with expanding catalog breadth and use cases.



The role requires balancing automated quality systems with pragmatic human-in-the-loop review where needed until confidence and coverage are high. Quality for Vertical Search will be measured with clear, trusted metrics rather than inferred only from downstream engagement signals. Search and Assistant launches will have reusable relevance-evaluation coverage, stronger release confidence, and faster debugging loops. The team can scale quality across a growing number of subscription services and Roku Channel experiences without linear growth in manual effort.

How AI is used at Roku

At Roku, AI agents do most of the keystroke-level coding. Engineers act as the technical leads for those agents, setting context, planning work, verifying outputs, and recovering when the agent goes off course. If you are excited about working this way, we want to talk to you.

At Roku, we're embracing AI as a powerful tool to amplify human

📌 Senior Software Engineer, Test (Bengaluru)
🏢 Roku
📍 Bengaluru