About Dusker AI

Dusker AI specializes in benchmarking and evaluating AI agents to help organizations understand real-world performance. Using expert-driven frameworks, we assess AI systems across reasoning, reliability, adaptability, and safety to ensure they perform consistently in production environments. By identifying strengths and uncovering critical gaps, Dusker AI empowers organizations to build trustworthy, deployment-ready AI solutions.

Role Overview

We are looking for a passionate
LLM Engineer
to join our remote team. In this role, you will design, develop, and optimize Large Language Model (LLM) applications, AI agents, and evaluation workflows. You will work closely with researchers and product teams to build intelligent systems, improve model performance, and create scalable AI solutions that power the next generation of AI evaluation.

Key Responsibilities
- Design, develop, and optimize LLM-powered applications and AI agents.
- Build prompt engineering pipelines and agent workflows.
- Develop integrations with LLM APIs and AI tools.
- Implement and improve RAG pipelines,



tool calling, and agent orchestration.
- Design experiments to evaluate reasoning, reliability, and model performance.
- Analyze benchmark results and optimize AI behavior.
- Develop internal tools for automated evaluation, testing, and monitoring.
- Collaborate with research, engineering, and product teams.
- Write clean, maintainable, and well-documented code.

Required Qualifications
- Solid proficiency in
Python
and software development.
- Experience working with
LLMs
,
Prompt Engineering
, and
AI Agents
.
- Hands-on experience with
LangChain
,
LangGraph
,
LlamaIndex
, or similar AI frameworks.
- Understanding of
RAG
, vector databases, embeddings, and LLM orchestration.
- Experience integrating AI models using APIs.
- Knowledge of machine learning fundamentals, evaluation metrics, and experimentation.
- Familiarity with Git, testing, and technical documentation.
- Excellent a

📌 LLM Engineer (India)
🏢 Dusker AI
📍 India