About The Company

Synthires is a pioneering research organization dedicated to advancing the frontiers of artificial intelligence and machine learning. Backed by prominent investors including Y Combinator and Box Group, Synthires focuses on developing innovative datasets, benchmarking standards, and experimental methodologies to push the boundaries of AI capabilities. The company's mission is to foster groundbreaking research that not only enhances the understanding of AI systems but also sets recent industry standards.

With a collaborative and forward-thinking environment, Synthires attracts top-tier researchers and engineers committed to solving complex AI challenges and translating scientific insights into practical applications.

About The Role The position of ML Research Expert — Published First Author (Benchmark Authoring) at Synthires offers an exciting opportunity for experienced machine learning researchers to contribute to the creation and validation of benchmark tasks that accurately measure the capabilities of cutting-edge AI models. This is a remote, contract-based role designed for individuals with a strong publication record and hands-on research experience in machine learning. The successful candidate will leverage their expertise to design realistic, technically rigorous research problems, develop reference solutions, and establish evaluation criteria that reflect real-world ML research workflows.

This role is ideal for researchers passionate about shaping the future of AI evaluation and standards, working independently within a flexible schedule while making a significant impact on the AI research community.

Qualifications The ideal candidate will possess a strong academic background and proven research experience in machine learning or related fields.



Candidates should have at least one first-author research publication in recognized ML or AI venues, demonstrating their ability to conduct original research and report technical findings. A master's or PhD degree in Machine Learning, Computer Science, Statistics, Mathematics, or a similar quantitative discipline is required, with ongoing or completed studies.

Practical experience of at least one year in conducting hands-on ML research—including coding, training, evaluation, and experimentation—is essential. Candidates must also demonstrate expertise in at least one core ML research area and possess the ability to design and evaluate complex research problems. Strong communication skills and the ability to produce reproducible, high-quality technical work are critical for success in this role.

Responsibilities

- Design realistic and technically rigorous machine learning research tasks and problem sets within your area of specialization, ensuring they accurately reflect current research challenges.
- Develop benchmark challenges that evaluate the ability of AI models to solve authentic ML research problems, fostering progress in model capabilities.
- Author expert-level reference solutions for assigned research tasks, providing clear and reproducible methodologies.
- Create detailed grading rubrics to enable consistent and objective evaluation of model performance across different tasks.




- Apply hands-on machine learning research experience to validate the quality, relevance, and reproducibility of benchmark content.
- Ensure all tasks and solutions adhere to high technical standards, are challenging yet achievable, and are aligned with real ML research workflows.
- Validate research tasks and solutions against established technical and methodological standards, iterating improvements as needed.

Benefits This role offers competitive compensation ranging from $140 to $150 per hour, reflecting the high level of expertise required. The engagement is fully remote and versatile, allowing you to set your own schedule within a commitment of approximately 5 to 40 hours per week. Working as an independent contractor, you will be part of a energetic team focused on pioneering AI benchmarks and evaluation methodologies. This position provides an excellent opportunity to contribute to cutting-edge AI research, collaborate with leading experts in the field, and expand your professional portfolio through impactful publications and benchmark development. Additionally, Synthires offers a supportive environment that values innovation, technical excellence, and scientific integrity.

Equal Opportunity

Synthires is committed to fostering an inclusive and diverse work environment. We are an equal opportunity employer and do not discriminate based on race, ethnicity, gender, age, disability, sexual orientation, or any other protected characteristic. We believe that diverse perspectives drive innovation and excellence in research, and we welcome applicants from all backgrounds to contribute to our mission of advancing artificial intelligence through rigorous scientific inquiry.

📌 AI & ML Researcher (India)
🏢 taskverse
📍 India