08 Oct
|
CodeRound AI
|
India
08 Oct
CodeRound AI
India
????? ??? ???
This role is for one of our client companies — a VC-backed Software Development, AI Infrastructure, Automotive, and Telecommunications startup that has raised $2M USD in funding.
??????: Up to 35LPA
Apply once and, if selected, get access to up to 20 remote and onsite interview opportunities.
? ???? ??'?? ????????
CodeRound AI matches the top 5% tech talent with the fastest-growing, VC-funded AI startups across Silicon Valley and India.
Top-tier product startups across the US, UK, EU, UAE, and India have hired top engineers through CodeRound.
? ?? ???????? ???????? (3+ ????? ?? ??????????)
We’re seeking an AI Research Engineer to own model evaluations end-to-end, turning ambiguous capabilities into rigorous, reproducible benchmarks. Working closely with researchers, you will design datasets, analyze model behavior at scale, and directly shape the training lifecycle.
? ???? ???'?? ??
• Design rigorous benchmarks for reasoning, coding, and agentic capabilities across C/C++, Rust, embedded systems, hardware specifications, and engineering tasks.
• Develop deterministic evaluators using compilers, emulators, simulators, static analysis, formal verification, and hardware-in-the-loop systems.
• Build distributed infrastructure to run evaluations reliably against models and live training checkpoints.
• Diagnose regressions and anomalous results, separating model failures from issues in prompts, data, evaluators, or infrastructure.
• Design robust metrics, difficulty curricula, contamination-resistant tasks, and experiments around prompting, sampling, and scaffolding.
• Turn evaluation failures into targeted datasets, reward signals, and new training objectives in collaboration with RL researchers.
• Create dashboards, experiment tracking, and evaluation libraries that make model performance easy to understand and trust.
✅ ???'?? ? ????? ??? ?? ???
• Solid Python programming and software engineering fundamentals.
• Experience building benchmarks, evaluation
📌 AI Research Engineer (India)
🏢 CodeRound AI
📍 India