Required Skills & Experience

Must-Haves:

- 8+ years of experience in API Management, Middleware, or Platform Engineering
- 5-8+ years of hands-on Kong Gateway Administration experience
- Strong experience with Kong Gateway (OSS/Enterprise) and Kong Konnect
- AI Gateway and LLM Proxy development experience
- Experience integrating OpenAI and Azure OpenAI environments
- Expertise in API Management and API Lifecycle Management
- Solid understanding of REST APIs and GraphQL
- Experience with OAuth2, JWT, OIDC, and API Security
- Kubernetes, Docker, and Helm deployment experience
- CI/CD experience using Jenkins, GitHub Actions, or Azure DevOps
- Experience with Prometheus, Grafana, ELK, or Splunk
- Experience working in Azure, AWS, or GCP environments
- AI Security, Responsible AI, and Model Governance knowledge
- Multi-LLM integration experience (OpenAI, Azure OpenAI, Claude, Gemini, Mistral, Llama)
- Experience building governance frameworks for API and AI platforms
- Strong stakeholder management and project leadership experience

Nice to Have Skills & Experience

Plusses

- Experience with Retrieval-Augmented Generation (RAG) architectures
- Experience with Vector Databases
- LLMOps and AI Observability experience
- Prompt Management, Semantic Caching, and Response Optimization expertise
- Token monitoring, cost governance, and usage analytics experience
- MCP (Model Context Protocol) and AI Agent integration experience
- Experience establishing enterprise GenAI platform standards
- Cloud-native and microservices architecture experience
- Vendor management and coordination experience

Day-to-Day:
- Design and implement enterprise-scale AI Gateway solutions utilizing Kong AI Gateway
- Configure AI policies including prompt logging, content filtering, token controls, and guardrails
- Enable secure access to multiple LLM providers through centralized gateway architecture




- Implement AI observability, token analytics, usage monitoring, and cost governance strategies
- Develop intelligent AI routing strategies based on latency, availability, and cost
- Integrate RAG-based AI services into secure API frameworks
- Ensure compliance with AI governance, security, and regulatory requirements
- Establish reusable AI APIs and enterprise GenAI best practices
- Support AI agent and MCP-based integrations
- Maintain platform reliability, scalability, and operational excellence
- Administer and support Kong Gateway environments
- Develop and manage AI Gateway proxy solutions for GenAI and LLM services
- Implement API authentication, security, throttling, and governance policies
- Deploy and manage Kong within Kubernetes environments
- Monitor, troubleshoot, and optimize platform performance
- Automate deployments and operational processes through DevOps tooling
- Collaborate with application, security, cloud, and AI teams on gateway strategy and modernization initiatives
- Track project delivery, mitigate risks, and communicate with stakeholders

: Insight Global is seeking an AI Platform Engineer with deep expertise in Kong Gateway Administration, API Management, and AI Gateway technologies for a leading enterprise technology client. This individual will serve as a technical leader responsible for driving AI gateway strategy, implementing secure and scalable API platforms, and enabling enterprise adoption of GenAI capabilities. The ideal candidate will have extensive experience with Kong AI Gateway, LLM proxy development, multi-model integrations, and cloud-native technologies.

This role will partner closely with application, security, cloud, and AI teams to deliver innovative AI platform solutions, establish governance standards, optimize AI consumption, and ensure secure, reliable access to enterprise AI services across multiple LLM providers.

📌 AI Architect (Bengaluru)
🏢 Insight Global
📍 Bengaluru