We are looking for a Machine Learning Engineer with deep, hands-on experience training ML and open-source LLM models to build state-of-the-art (SOA) open-source models tailored for our AI evaluation and AI test execution platforms.
Key Responsibilities
- Train & fine‑tune models (ML + LLM, open‑source)
- Optimize models for AI evaluation, test generation, scoring
- Own lifecycle – data prep, training, validation, benchmarking
- Collaborate with AI QA to define evaluation criteria & failure modes
- Ensure models are deployable, observable, and cost‑aware
Must‑Have Skills
- 5–10+ yrs applied ML experience
- Strong open‑source LLMs (LLaMA, Mistral, Falcon)
- Proficiency in Python & PyTorch
- Expertise in fine‑tuning techniques (LoRA, adapters, SFT)
- Model evaluation, architecture trade‑offs, bias/failure modes
Positive‑to‑Have
- Domain‑specific models
- Distributed training experience
- Contributions to open‑source ML projects
- Exposure to RAG & embeddings
- Supporting models in production environments