14 Oct
|
datavruti
|
Chennai
Hiring for: A US-based, AI-first data solutions company founded by seasoned technology leaders.
Role: Senior Data & AI Quality Engineer - Chennai (Hybrid)
Positions: 1
Experience: 5 to 10 years
Location(s): Chennai
Type: In office, Hybrid / Permanent
Salary: Up to INR 25 LPA (best as per the fitment)
Notice Period: Immediate to 30 days
Key Responsibilities:
- Ingestion pipelines: Confluence, SharePoint/Microsoft 365 (Graph), and repository connectors - parsing, chunking, metadata, incremental sync, data-quality controls
- Synthetic and non-production data design: corpora shaped to banking IT content (runbooks, incidents, KB articles, change records) with realistic permission structures the foundation of the cloud-first build
- The evaluation harness as a product: golden question sets, retrieval precision/faithfulness/citation-accuracy scoring, the zero-leakage permission suite, the zero-unauthorized-actions agent suite; CI-integrated regression gates
- Performance and load testing with the platform engineer: concurrency profiles, soak tests, degraded-mode behavior
- UAT orchestration and defect triage across both use cases; acceptance evidence packs per milestone
- Measurement reporting foundations: the before/after value metrics (time saved per incident, per search) the client's executives receive monthly
Technical Skills:
- 5+ years across data engineering and quality engineering with production Python; you have built pipelines AND the tests that police them
- LLM evaluation experience: has designed or operated retrieval/generation quality measurement with numeric thresholds (RAGAS-class metrics, custom harnesses, or equivalent) not just eyeballed outputs
- Document-processing depth: parsing real enterprise content (tables, permissions, versions, mess), chunking trade-offs, metadata design
- Test-suite craftsmanship: negative and adversarial test design the leakage suite is a security artifact, and you think like an attacker when writing it
- Load/performance testing experience (Locust, k6, or equivalent) and defect-triage discipline
📌 Senior Data & AI Quality Engineer - Chennai - upto 25LPA
🏢 datavruti
📍 Chennai