We are looking for experienced software engineers to work on a freelance basis on RLHF projects that support the training and evaluation of AI coding agents. Depending on the project, the work can involve designing realistic technical tasks, or reviewing and rating AI generated responses for correctness, clarity, and reliability. It suits engineers who enjoy accurate technical writing and careful quality review as much as building.

Key Responsibilities
Design technical tasks across areas such as software development, debugging, data processing, security, and machine learning, and set up any supporting workplace and automated tests needed to validate them, where the project calls for task authoring.
Review AI generated responses to technical tasks, assessing correctness, code quality, and adherence to instructions.
Provide clear, evidence based written feedback and comparative ratings across responses.
Validate task or evaluation difficulty against AI model outputs and revise based on review feedback.

Desired Candidate Profile

Highly Required
4 to 7 years of experience building production systems, not just internal tools.




Strong hands on skill in Typescript, Javascript
Comfortable with Docker.
Comfortable working with one relational and one NoSQL database.
Can point to a explicit before and after metric from past work.
Experience working with remote or international clients or teams.
Some exposure to secure data handling or compliance work.

Preferred
Has integrated an AI or LLM API into a real, shipped feature.
Experience in AI training and evaluation work.

Employment Type Contractual/Freelance
Key Skills Python, Java, JavaScript, Docker, AI Integration, Typescript

Evaluation Process
After you apply through Naukri, we will share an Information Form with you.
Once you submit the completed form, our team will review the information provided.
Shortlisted candidates will receive interview slots for the next stage of the evaluation process.
Further details regarding the selection process and subsequent steps will be discussed over a call once you are shortlisted.

📌 Ai Evaluator Typescript Freelance Opportunity New Delhi (India)
🏢 Biz-Tech Analytics
📍 India