About The Role

We are looking for a Senior AI/ML Engineer who can take AI features from prototype to production with

confidence. You will own the full lifecycle of our LLM-powered systems — from benchmarking model and

pipeline performance, to hardening the stack for scale, to shipping it live to real users. This role sits at the

intersection of applied LLM/GenAI work and MLOps, and is critical to how quickly and reliably we can put new AI

capabilities in front of customers.

You will work closely with product, backend, and design to make sure what we ship is rapid, accurate, cost-

efficient, and observable in production.

What you will do

Design, build, and ship LLM-powered features end-to-end — including RAG pipelines, agentic workflows,

prompt orchestration, and fine-tuning where it makes sense.

Define and run benchmarking frameworks for our AI applications: latency, throughput, accuracy,

hallucination rate, cost per request, and quality regressions across model and prompt changes.

Establish offline evals (golden sets, LLM-as-judge, human-in-the-loop)



and online evals (A/B tests,

shadow traffic, canary releases) before any model or prompt goes live.

Take models and pipelines to production: containerize, deploy, autoscale, and monitor inference

services with clear SLOs for latency, error rate, and cost.

Build the MLOps backbone — CI/CD for models and prompts, versioning, feature stores where needed,

observability (traces, metrics, logs), and rollback paths.

Optimize inference performance and cost: batching, caching, quantization, distillation, model routing,

and choosing the right managed vs. self-hosted trade-offs.

Partner with product to translate fuzzy product asks into measurable AI quality bars, and own the “is

this good enough to ship?” decision with data behind it.

Mentor other engineers on LLM best practices, eval rigor, and production readiness.

What we are looking for

3–6 years of engineering experience, with a meaningful portion spe

📌 Senior AI/ML Engineer (Chennai)
🏢 zocket-test
📍 Chennai