About The Chance

Careerbloc is a next-generation talent and AI evaluation platform empowering enterprises to hire with precision by assessing technical skills through real-world, code-first evaluations. We blend human expertise with AI-powered validation to deliver unbiased, scalable assessments for software engineering and technical roles across the globe—helping companies future-proof their tech teams and candidates showcase their true capabilities.

Role & Responsibilities

Design, validate, and execute AI-driven evaluation frameworks for software engineering candidates—focusing on code quality, algorithmic efficiency, and system design patterns.
Build and maintain scalable code evaluation rubrics using real-world programming challenges (Python, Java, JavaScript, SQL, etc.) aligned with industry-grade engineering standards.
Analyze candidate submissions using static analysis tools, automated test suites, and manual code reviews to ensure fair, objective, and context-aware scoring.
Collaborate with AI/ML engineers to fine-tune LLM-based evaluation models for assessing code correctness,



readability, edge-case handling, and optimization.
Identify and eliminate evaluation biases in test cases, improve scoring logic, and contribute to continuous feedback loops for model refinement.
Document evaluation workflows, maintain test case libraries, and train QA/assessment teams on evaluation best practices and tooling.

Skills & Qualifications

Must-Have

Python
Java
JavaScript
SQL
Git
Unit Testing
Code Review
CI/CD Pipelines

Preferred

Experience with LLM evaluation frameworks (e.g., LangChain, RAG, LlamaIndex)
Familiarity with code quality tools (SonarQube, Codacy, ESLint)
Knowledge of SDE interview patterns (LeetCode, HackerRank-style assessments)

Benefits & Culture Highlights

100% remote with flexible hours—work from anywhere in India.
Impact-driven culture: your work directly shapes how millions of engineers are assessed globally.
Continuous learning: access to

📌 Technical AI Evaluation Speclalist (India)
🏢 CAREERBLOC ~
📍 India