We are hiring | AI/LLM Associate Engineer

Company: 3Wheels.AI

Location: Lucknow, Uttar Pradesh (100% On-site)

Experience: 6 Months

Employment Type: Full-time

Salary : 15k to 16k per month

About the role

We are looking for a technically curious and detail-oriented AI/LLM Associate Engineer to join our engineering team. You will work on evaluating LLM outputs, testing autonomous AI agents, benchmarking models, and assessing RAG systems to improve the accuracy, reliability, and performance of AI solutions.

Key Responsibilities

- Design benchmark datasets, test cases, and evaluation criteria for LLMs.
- Evaluate AI/LLM outputs and analyze model performance.
- Test autonomous agents, tool-calling workflows, and identify execution failures.
- Evaluate RAG pipelines for retrieval accuracy and response quality.
- Work with automated evaluation techniques, including LLM-as-a-Judge.
- Identify hallucinations, inconsistencies, and potential security vulnerabilities.
- Prepare evaluation reports and document performance findings.

Key Requirements

- Good understanding of Python fundamentals and data structures.




- Knowledge of AI/ML, LLMs, Generative AI, and prompt engineering.
- Understanding of RAG architecture, vector embeddings, APIs, and AI agents.
- Familiarity with evaluation metrics such as Accuracy, Precision, Recall, and F1-score.
- Basic knowledge of ML concepts, train/test splits, and model evaluation.
- Solid analytical, logical reasoning, and problem-solving skills.

Required Qualification

- B.Tech / B.E. / BCA / MCA / M.Tech in CS, IT, AI/ML, Data Science, or related fields.
- 6 months of relevant experience in AI/ML, Data Science, or Python development.
- Willingness to learn and work on emerging AI technologies.

Why Join Us?

- Work on real-world LLMs, RAG systems, and autonomous AI agents.
- Gain hands-on experience with advanced AI evaluation techniques.
- Collaborate with AI researchers and engineering teams.

Join us and help build more reliable and intelligent AI systems! For queries: [email protected] or (phone hidden)

📌 AI/LLM Associate Engineer (Lucknow)
🏢 3Wheels.Ai
📍 Lucknow