Hiring Associate AI/LLM Engineer

Company: 3 Wheels.Ai

Job Location: Lucknow

Experience: 6 months

Salary: 14k to 16k in hand

Employment Type: Full time

Work Mode: On-site

About the role

3 Wheels AI is looking for an AI/LLM Engineer with strong Python programming skills and hands-on knowledge of LLM evaluation, benchmarking, RAG pipelines, and autonomous AI agents. The role focuses on testing and improving the performance, accuracy, and reliability of AI-powered systems.

Key Responsibilities

- Design benchmark datasets, test cases, and evaluation criteria for LLMs.
- Evaluate LLM outputs and analyze model performance.
- Test autonomous agents, tool-calling workflows, and identify execution failures.
- Evaluate RAG pipelines for retrieval accuracy and response quality.
- Implement automated evaluation techniques, including LLM-as-a-Judge.




- Identify hallucinations, inconsistencies, and potential security vulnerabilities.
- Prepare evaluation reports and document performance findings.

Required Skills and Qualifications

- Strong Python programming and problem-solving skills.
- Good understanding of LLMs, Generative AI, and NLP fundamentals.
- Knowledge of RAG, embeddings, and vector databases.
- Familiarity with AI agents, function calling, and tool-use workflows.
- Understanding of LLM benchmarking and evaluation frameworks such as RAGAS and DeepEval.
- Strong analytical and debugging skills.

Interested candidates can share their updated resumes at [email protected] or (phone hidden)

📌 AI/LLM Engineer (Associate) (Lucknow)
🏢 3Wheels.Ai
📍 Lucknow