Job Description

This is a remote position.

We are looking for a hands-on Senior AI Engineer with 4-6 years of engineering experience and deep, current expertise in building Generative AI systems that run in production. This is a core AI engineering role, not a data analysis or reporting role: you will spend your time on LLM application architecture, retrieval design, agentic systems, fine-tuning, evaluation, inference optimization and model serving. We expect a solid grasp of how transformer models actually behave, including tokenization, context windows, attention costs, embeddings and decoding, and the ability to turn that understanding into systems that are accurate, fast and affordable at scale. You will own AI components end to end, from data and retrieval pipelines through model integration, evaluation harnesses, deployment and production monitoring, and will work directly with product managers, solution architects and client stakeholders on enterprise AI delivery. As a senior engineer you will also set the technical direction on the AI components you own,



review the work of others, and raise the bar for what ships. The role suits an engineer who reads papers and model cards, prototypes quickly, and holds a high standard for production quality.

Requirements

Responsibilities

Design and build production LLM applications: RAG pipelines, agentic and tool-calling systems, and multi-step reasoning workflows.
Engineer retrieval layers on vector databases, covering chunking strategy, embedding model selection, metadata filtering, hybrid search and re-ranking.
Design context and prompting strategies: system prompt architecture, structured output, function/tool schemas, context compression and memory management.
Build evaluation harnesses and guardrails to measure accuracy, groundedness, safety, regression and hallucination rates, and drive improvements from the results.
Optimize inference cost and latency through caching, batching, model routing, quantization, st

📌 Senior AI Engineer- Remote, India (Gurugram)
🏢 LeewayHertz
📍 Gurugram