Hiring Associate AI/LLM Engineer Company: 3 Wheels.
Ai Job

Location:
Lucknow

Experience:
6 months

Salary:
14k to 16k in hand Employment Type: Full-time Work Mode: On-site

About the role
3 Wheels AI is looking for an AI/LLM Engineer with robust Python programming skills and hands-on knowledge of LLM evaluation, benchmarking, RAG pipelines, and autonomous AI agents. The role focuses on testing and improving the performance, accuracy, and reliability of AI-powered systems.

Key Responsibilities

- Design benchmark datasets, test cases, and evaluation criteria for LLMs.
- Evaluate LLM outputs and analyze model performance.
- Test autonomous agents, tool-calling workflows, and identify execution failures.
- Evaluate RAG pipelines for retrieval accuracy and response quality.
- Implement automated evaluation techniques, including LLM-as-a-Judge.




- Identify hallucinations, inconsistencies, and potential security vulnerabilities.
- Prepare evaluation reports and document performance findings. Required Skills and Qualifications
- Solid Python programming and problem-solving skills.
- Good understanding of LLMs, Generative AI, and NLP fundamentals.
- Knowledge of RAG, embeddings, and vector databases.
- Familiarity with AI agents, function calling, and tool-use workflows.
- Understanding of LLM benchmarking and evaluation frameworks such as RAGAS and DeepEval.
- Strong analytical and debugging skills. Interested candidates can share their updated resumes at [email protected] or (phone hidden)

📌 AI/LLM Engineer (Lucknow)
🏢 3Wheels.Ai
📍 Lucknow