About the Role
We are hiring a Tech Lead - Data Scientist to play a key role in building our Agentic AI Platform — a system of autonomous, tool-using AI agents that plan, reason, and execute complex business workflows end-to-end. The ideal candidate combines robust ML fundamentals with hands-on experience in LLM-based application development, agent orchestration frameworks, and Microsoft Azure cloud services. You will architect and ship production-grade agentic solutions, mentor junior team members, and set technical direction for GenAI initiatives across the organization.

Experience -8 to 12 yrs
Key Responsibilities
• Design, build, and productionize multi-agent systems — including planning, tool calling / function calling, memory, and orchestration — using frameworks such as LangGraph, AutoGen, CrewAI, or Semantic Kernel.

• Develop RAG pipelines end-to-end: document ingestion, chunking strategies, embeddings, vector search (Azure AI Search / FAISS / pgvector), re-ranking, and grounding for agent knowledge.





• Integrate agents with enterprise systems and APIs via tool/function calling and Model Context Protocol (MCP) or similar connector patterns.

• Build and maintain LLM evaluation frameworks for agentic workflows — task-completion metrics, hallucination detection, trajectory analysis, LLM-as-judge pipelines, and A/B testing.

• Implement guardrails, safety, and governance for agents: prompt-injection defense, content filtering, role-based tool permissions, human-in-the-loop checkpoints, and audit logging.

• Fine-tune and optimize LLMs where needed (LoRA/PEFT, prompt optimization, model routing, latency/cost trade-offs) on Azure OpenAI / Azure AI Foundry.

• Design, build, and evaluate classical ML models (classification, regression, forecasting, NLP) where they complement agentic workflows.

• Own LLMOps/MLOps for the platform: experiment tracking, prompt versioning, CI/CD, observability and tracing (LangSmith, Azure Monitor, OpenTelemetry), drift monitoring,

📌 Tech Lead (Mumbai)
🏢 Johnson Controls
📍 Mumbai