Job Title: LLM - Engineering Expert

Employment Type: Contract
Positions Open: 210
Duration: Up to 24 weeks
Start Date: Immediate
Location: Remote (Bangladesh, India, Indonesia, Egypt, Ghana, Kenya, Nigeria, Turkey, Brazil, Colombia)
Work Hours: Full time, 40 hrs/week with 4 hours overlap with PST
Rate: $300 per task (considering 30-40 hours AHT per task)

Key Skills: Python, ngspice, PySpice, OpenFOAM, FEniCSx, CalculiX, python-control, CadQuery, build123d, OpenModelica, Cantera, Gmsh, LLM Evaluation, Coding Agents, Failure-Mode Analysis, Trajectory Analysis, Engineering Simulation, Electrical Engineering, Mechanical Engineering, Aerospace Engineering, Control Systems, Robotics

About the Role We are seeking experienced AI Evaluation Engineers (Engineering Simulation & Design) to author and validate "model-breaking," simulation-based engineering design problems to train and evaluate state-of-the-art AI agents. Operating across major engineering disciplines—including Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics—you will create complex,



multi-constraint tasks where AI agents must interpret requirements, navigate trade-offs, configure open-source simulation tools, diagnose failures, and iterate toward valid solutions. You will analyze agent execution logs, expose systemic reasoning gaps, and build automated, objective graders to elevate frontier model performance.

Job Requirements
- Education & Expertise: Master's degree or PhD in Electrical, Mechanical, Aerospace, with 10+ years of hands-on engineering design experience.
- Simulation Tooling: Proficiency with at least one domain-relevant open-source simulation package (e.g., ngspice, PySpice, OpenFOAM, FEniCSx, CalculiX, python-control, CadQuery, build123d, OpenModelica, Cantera, Gmsh) combined with strong Python scripting skills.
- AI Evaluation & Failure Diagnostics: Hands-on experience with modern LLMs/coding agents and evaluation concepts (pass@k, failure-mode analysis, nondeterminis

📌 LLM Engineering Expert (India)
🏢 Consultbae India
📍 India