07 Aug
|
Cheq Digital
|
Bengaluru
07 Aug
Cheq Digital
Bengaluru
":"
About CheQ
At CheQ, wee turning the chaos of credit into a journey that clear, rewarding, and even a little fun. With \u20b980,000 Cr+ in lifetime payments, a growing tribe of users (30%+ using more than two products), and $16M raised from marquee investors, wee fast becoming India favorite way to go from credit-stressed to credit-smart.
Founded by ex-Flipkart leader Aditya Soni and backed by 3one4 Capital, Venture Highway, Ram Shriram, Lloyd Mathias and more, CheQ isn just another fintech, it a full-stack credit experience.
About the Role
Wisor is an AI-powered financial assistant within the CheQ ecosystem that helps users understand their credit cards, rewards, spends, and financial profile through conversational AI. We are looking for a Product Operations Associate to own data quality, evaluation operations, and production monitoring processes that directly impact the accuracy and reliability of the product.
Key Responsibilities
Data Annotation & Quality Operations
- Review, annotate, and validate large-scale datasets including transaction data, merchant mappings, category classifications, and production logs.
- Improve merchant and category annotation accuracy through continuous audits and corrections.
- Create, maintain, and expand golden datasets for model training, benchmarking, and evaluation.
- Identify data quality gaps and collaborate with Product, Data Science, and Engineering teams to resolve them.
AI Evaluation & Benchmarking
- Own manual evaluation of AI responses across different components of the Wisor response pipeline.
- Benchmark model outputs and track quality metrics over time.
- Conduct regular audits of user interactions to identify hallucinations, inaccuracies, and poor user experiences.
- Review and analyze all 1-star rated user interactions and support RCA creation.
Production Monitoring & RCA Support
- Monitor production logs and user feedback to proactively identify issues.
- Support incident investigations and root cause analysis.
- Maintain evaluation frameworks, annotation guidelines, and quality dashboards.
- Work closely with Product Managers to prioritize fixes and improvements.
Requirements
- 13 years of experience in Product Operations, Data Operations, QA, Analytics, or related roles.
- Strong analytical mindset and attention to detail.
- Comfortable working with large datasets and spreadsheets.
- Basic understanding of AI/LLM products and evaluation concepts.
- Familiarity with SQL, and python is preferred.
- Robust communication and documentation skills.
Why should you join CheQ
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Product Operations Associate (Bengaluru)
🏢 Cheq Digital
📍 Bengaluru