We are building production-grade AI systems for capital markets, including an AI-powered investing assistant that runs on cloud-native infrastructure and integrates with regulated trading and research platforms. We are hiring a Senior AI Engineer to build, evaluate, and operate LLM-based products end to end.
This is a deeply hands-on role. You will write code, debug live systems, run evaluations, and ship to production. We are not looking for someone whose AI experience is limited to wiring up a hosted chat API — we expect you to have personally built, broken, and fixed LLM systems in production.
Experience
5–8 years in software engineering, with 2+ years on LLM/AI products in production.
Robust track record of shipping AI features that are actually used by real users at scale.
Required Skills
1. LLM Hosting & Serving
Hands-on experience hosting LLMs for testing, evaluation, and production inference.
Working knowledge of inference servers and runtimes: v LLM, TGI (Text Generation Inference), Tensor RT-LLM, Ollama, llama.cpp.
Experience deploying open-weight models (Llama, Mistral,



Qwen, Nemotron, GPT-OSS, Deep Seek, etc.) on GPU instances — knowledge of quantization (GPTQ, AWQ, GGUF, FP8), batching strategies (continuous batching, paged attention), and KV-cache management.
Experience with managed model hosting platforms: AWS Bedrock, Sage Maker, Azure Open AI, Vertex AI, or equivalent.
Ability to choose between hosted APIs and self-hosted inference based on cost, latency, throughput, and data-residency constraints — and to defend that choice with numbers.
2. LLM Evaluation & Testing
Designing and running case-specific test suites for LLM-based applications — not just generic benchmarks.
Building eval datasets from production traffic, edge cases, and adversarial prompts. Experience curating golden datasets and maintaining them as the product evolves.
Hands-on with evaluation frameworks: Langfuse, Promptfoo, Deep Eval, RAGAS, Open AI Evals, LM-Eval-Harness, or equival

📌 Artificial intelligence engineer (Bengaluru)
🏢 HDFC Securities
📍 Bengaluru