Hiring Associate AI/LLM Engineer Company: 3 Wheels.
Ai Job

Location:
Lucknow

Experience:
6 months

Salary:
14k to 16k in hand Employment Type: Full-time Work Mode: On-site

About the role
3 Wheels AI is looking for an AI/LLM Engineer with strong Python programming skills and hands-on knowledge of LLM evaluation, benchmarking, RAG pipelines, and autonomous AI agents. The role focuses on testing and improving the performance, accuracy, and reliability of AI-powered systems.

Key Responsibilities
• Design benchmark datasets, test cases, and evaluation criteria for LLMs.
• Evaluate LLM outputs and analyze model performance.
• Test autonomous agents, tool-calling workflows, and identify execution failures.
• Evaluate RAG pipelines for retrieval accuracy and response quality.
• Implement automated evaluation techniques, including LLM-as-a-Judge.




• Identify hallucinations, inconsistencies, and potential security vulnerabilities.
• Prepare evaluation reports and document performance findings. Required Skills and Qualifications
• Robust Python programming and problem-solving skills.
• Good understanding of LLMs, Generative AI, and NLP fundamentals.
• Knowledge of RAG, embeddings, and vector databases.
• Familiarity with AI agents, function calling, and tool-use workflows.
• Understanding of LLM benchmarking and evaluation frameworks such as RAGAS and DeepEval.
• Strong analytical and debugging skills. Interested candidates can share their updated resumes at [email protected] or (phone hidden)

📌 AI/LLM Engineer (Lucknow)
🏢 3Wheels.Ai
📍 Lucknow