Job Summary

AI Engineer (LLM Applications) - Bengaluru, India

Responsibilities

- The AI Mentor: using a student's roadmap, courses, and profile as context so its advice is specific and useful
- Resume Lab: structured feedback on resumes that is consistent and actionable
- Roadmap generation: turning a student's goal and current skills into a realistic 30/60/90-day plan
- Retrieval over course content, so answers are grounded in what Ucanly actually teaches
- Evaluation sets and automated checks that measure quality before any change ships
- Guardrails that keep responses honest, on topic, and appropriate for students
- Monitoring cost and response time, and reducing both where possible
- Build and improve LLM-powered features including the AI Mentor, Resume Lab, and roadmap generation
- Design context pipelines that bring in each student's profile, roadmap, and course progress
- Build and maintain retrieval over course content, including chunking, embeddings, and search
- Write and version prompts, and use structured outputs where the product needs reliable formats
- Build evaluation datasets and automated checks, and run them before every release
- Add guardrails for accuracy, safety, and staying on topic
- Track model cost and latency, and make changes that reduce them without hurting quality




- Every change to a prompt or pipeline is tested against an evaluation set before release, and you will measure quality with data rather than by feel

Requirements

- Degree in Computer Science, IT, or a related field, or equivalent practical experience
- Good programming skills in Python or TypeScript
- Hands-on experience building with at least one LLM API
- Understanding of retrieval-augmented generation, embeddings, and vector search
- Experience building a backend API and working with a database
- At least one LLM project you can demo and explain, including how you checked its output quality
- Able to work from the Bengaluru office

Skills

- Ai
- Llm
- Rag
- Python
- Generative Ai
- Edtech

Frequently Asked Questions

- Do I need to have trained a model from scratchNo. This role is about building reliable applications on top of existing models, not training current ones.
- Can freshers applyYes, if you have built a working LLM project and can explain how you tested whether its answers were correct.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 AI Engineer (LLM Applications) (Bengaluru)
🏢 Ucanly
📍 Bengaluru