Company: Evalixa AI Private Limited
Engagement Type: Freelance / Independent Contractor
Work Mode: Remote
Location: India
Schedule: Versatile and project-based
To Apply: Send your resume and relevant details to
[email protected]
About Evalixa AI
Evalixa AI Private Limited is an AI benchmarking and evaluation company focused on developing challenging benchmarks, high-quality datasets, and reliable evaluation systems for frontier AI models.
We work on real-world technical environments designed to evaluate how advanced AI systems perform across machine learning, data analysis, software engineering, reasoning, and complex problem-solving tasks.
Role Overview
We are looking for experienced Data Analysts for MLE-Bench to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems.
In this role, you’ll work hands-on with production-like datasets, ML outputs, evaluation metrics, and analytical workflows to evaluate, diagnose, and understand the performance of advanced AI systems.
The ideal candidate is comfortable working at the intersection of data analysis and machine learning, with strong analytical skills and the ability to work with real-world datasets and ML evaluation workflows.
What You’ll Work On
Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines.
Define, calculate, and validate metrics used to evaluate model performance and behaviour.
Investigate data distributions, model outputs, failure modes, anomalies, and edge cases relevant to benchmark tasks.
Write and run Python and SQL code for data analysis and evaluation workflows.
Clean, transform, and validate complex datasets.
Validate data quality, consistency, completeness, and correctness across datasets and experiments.
Analyze and compare model outputs to identify meaningful performance differences.
Create reproducible and well-documented analytical workflows.
Evaluate AI-generated analytical solutions for correctn
📌 Data Analyst (Hyderabad)
🏢 Evalixa AI
📍 Hyderabad