: AI Evaluation Engineer – Engineering Simulation & Design

Job Title: AI Evaluation Engineer – Engineering Simulation & Design

Employment Type: Freelance Contract

Experience: 10+ years of hands-on engineering design experience

Contract Duration: Up to 24 weeks

Work Schedule: Full-time, 40 hours per week

Time Zone: 4 hours of overlap with PST

Work Model: Fully Remote

Joining: Immediate

Availability: Weekend availability required

Job Summary

ExcelGens is seeking experienced AI Evaluation Engineers specializing in Engineering Simulation and Design to develop, test, and evaluate complex engineering problems for advanced AI agents.

The ideal candidate will have a strong background in Electrical, Mechanical, or Aerospace Engineering, hands-on engineering design experience, solid Python programming skills, and proficiency in at least one open-source engineering simulation tool.

Key Responsibilities

- Design challenging engineering problems involving competing constraints and optimization objectives.
- Develop and validate reference solutions for engineering simulation tasks.
- Build and execute simulation environments using open-source engineering tools and Python-based test benches.
- Create automated grading systems to evaluate AI-generated engineering solutions.
- Test and evaluate AI agents using simulation-based engineering challenges.
- Analyze agent execution logs, identify failure patterns, and investigate reasoning and simulation errors.
- Validate physical plausibility, units, boundary conditions, and simulation convergence.
- Calibrate task difficulty and improve evaluation quality.




- Collaborate with AI researchers and engineering teams to improve model performance and reliability.

Required Skills and Experience

- Master's or PhD in Electrical, Mechanical, or Aerospace Engineering preferred, with 10+ years of hands-on engineering design experience.
- Strong Python programming and scripting skills.
- Proficiency in at least one open-source simulation or engineering design tool, such as:
- OpenFOAM
- ngspice / PySpice
- CalculiX
- FEniCSx
- OpenModelica
- python-control
- CadQuery / build123d
- Cantera / Gmsh
- Practical experience in engineering simulation, design, modeling, or optimization.
- Familiarity with modern LLMs, coding agents, and AI evaluation methods.
- Understanding of pass@k evaluation, failure-mode analysis, agent behavior, and execution trajectory logs.
- Strong analytical, debugging, and technical documentation skills.
- High attention to engineering accuracy, reproducibility, and physical validity.

Engagement Details

- Freelance contract for up to 24 weeks.
- Fully remote opportunity.
- Full-time commitment of 40 hours per week.
- Four hours of overlap with PST.
- Weekend availability required.
- Candidates must have a personal computer and stable, high-speed internet.

How to Apply

Interested candidates can share their updated resume and relevant engineering simulation projects or portfolio with the recruitment team at:

Email: [email protected]

#Hiring #FreelanceJobs #AIJobs #AIEngineering #AIEvaluation #EngineeringSimulation #SimulationEngineer #PythonJobs #MechanicalEngineering #ElectricalEngineering #AerospaceEngineering #LLMEvaluation #AIResearch #RemoteJobs #ContractJobs #ExcelGens

📌 AI Evaluation Engineer – Engineering Simulation (India)
🏢 ExcelGens
📍 India