We're hiring an experienced AI-native engineer to build the core systems behind Diligent's AI agents. This is not a prompt-writing role. This is a software engineering role for someone who can design reliable AI systems: prompts, context, tools, evals, orchestration, memory, observability, and production workflows.
Title: AI Harness Engineer
Experience: 5+ years
Location: Jaipur The Role
You'll work on the core agent architecture behind Diligent.Your job will be to build the harness around frontier models: prompt engineering, context engineering, tool design, agent orchestration, evals, memory, model routing, feedback loops, and human-in-the-loop systems.
What You'll Do
- Design and build AI agent workflows for marketing, growth, reporting, creative analysis, SEO/AEO, lead intelligence, and reputation monitoring.
- Build production-grade harnesses around LLMs using prompts, context, tools, memory, structured outputs, evals, guardrails, and human review loops.
- Work on prompt engineering, context engineering, tool calling, workflow decomposition, and agent orchestration.
- Build backend systems that connect with databases, APIs, CRMs, ad platforms, Slack, WhatsApp, dashboards, and internal tools.
- Design systems for ingesting, cleaning, storing, and retrieving business context for AI agents.
- Build evaluation pipelines to test prompt changes, model changes, agent quality, regressions, and edge cases.
- Implement model routing strategies to balance quality, latency, and cost. Improve observability: logs, traces, prompt versions, model outputs, failure analysis, and feedback loops.
- Work closely with product and growth teams to convert messy business workflows into reliable AI systems.
- Own engineering quality across architecture, code, testing, debugging, deployment, and maintenance.
Must-haves
- 5+ years of software engineering experience. Strong backend engineering and system design fundamentals.
- Hands-on experience building with LLMs, AI agents, prompt engineering, context engineering, RAG, tool calling, or agent frameworks.
- Strong software development fundamentals: clean code, APIs, databases, queues, testing, debugging, version control, and deployment.
- Experience with Python, Node.js, TypeScript, or similar backend stacks.
- Comfort working with Postgres, Redis, vector databases, queues, schedulers,and production services.
- Understanding of structured outputs, JSON schemas, retries, validation, error handling, and deterministic workflows.
- Ability to break ambiguous business workflows into clear technical systems.
- High ownership and comfort working in an early-stage startup environment.
Preferred skills:
- Experience with OpenAI, Anthropic, LangGraph, CrewAI, LlamaIndex, LangChain, MCP, or similar tools.
- Experience building evals for AI systems.
- Experience with tool servers, workflow engines, agent infrastructure, or automation platforms.
- Experience with marketing/adtech/growth tools such as Meta Ads, Google,
- Ads, GA4, HubSpot, Zoho, Shopify, Slack, WhatsApp, or CRMs.
- Experience with AWS, GCP, Azure, Vercel, Render, Railway, or similar cloud platforms.
- Experience with observability, tracing, logging, and production monitoring.
Interview Focus
- Backend engineering and system design.
- LLM/agent workflow experience beyond straightforward prompts.
- Prompt engineering, context engineering, and harness engineering depth.
- Ability to design evals, feedback loops, and observability for AI systems.
- Ability to decompose complex workflows into reliable technical components.
- Product thinking, ownership, and ability to work in ambiguity.
How To Apply
Email your CV to
[email protected] with.
1. A system you've built: briefly describe one technically complex system
you owned or contributed to.
1. An AI workflow you'd improve: pick any AI product or agent you've used and explain what you would improve in its harness, context, tools, or evals.
📌 AI Harness Engineer (Jaipur)
🏢 Where U Elevate®
📍 Jaipur