Role Summary
We are hiring a Senior AI / Python Engineer for one of the AI Initiative, which delivers an enterprise MCP (Model Context Protocol) platform connecting ChatGPT Enterprise to governed data in Databricks Unity Catalog. You will design and build core platform components, including the orchestration layer, account and entity resolution, and observability. You will also enhance the MCP server, engineer and evaluate prompts and agent instructions, enable current features, and own upgrades, releases, and production quality.

Key Responsibilities
Platform development
• Design and build the multi-agent orchestration layer: intent classification, semantic routing (embedding similarity with LLM fallback), agent handoffs, and clarification flows.
• Build and evolve account and entity resolution: alias indexes, fuzzy and semantic matching, batch index publishing with versioned swaps, and shadow-to-enforce rollouts, delivered as versioned, tested Python packages.
• Enhance the MCP server (FastMCP): tools, agents, and new features from requirements through release.




• Write design documents before coding and document trade-offs across accuracy, latency, and cost.

Prompt engineering and agent configuration
• Develop and refine prompts, agent instructions, tool descriptions, and semantic examples; reduce hallucination and tool-selection errors.
• Onboard and maintain agents: configuration, vector stores and recipe files, retrieval tuning, and SQL logic against Databricks Unity Catalog.

Observability, evaluation, and quality
• Instrument agents and tools with Langfuse (or equivalent) tracing; track prompt versions, token cost, latency, and quality per agent.
• Maintain evaluation suites (e.g., Promptfoo) with LLM-as-judge grading; add regression tests for every prompt or agent change and gate releases on the results.
• Own the audit and activity pipeline (CloudWatch, S3, Databricks); use logs, traces, and user feedback to improve routing, prompts, and retrieval.

Platform l

📌 Senior AI (India)
🏢 Vaisesika
📍 India