Core Responsibilities
5+ Years experience, Implement, maintain, and optimize AI Platform capabilities deployed on Google Kubernetes Engine (GKE) in Google Cloud Platform (GCP), enabling product teams to build and deploy Generative AI applications and self-hosted models.
Apply software and platform engineering best practices—including code quality, automated testing, CI/CD, GitOps, OTel telemetry, and documentation—to maintain reliable platform components and internal developer tooling.
Collaborate directly with application, data science, and platform teams to collect feedback, troubleshoot integration issues, and implement cloud-native AI tools and observability standards.
Stay current with advancements in AI infrastructure, GPU resource management, LLM serving engines, and cloud-native networking to continuously improve platform efficiency and developer experience.
Build and integrate platform components, custom K8s resources, and telemetry pipelines using solid software design patterns within the broader GCP/GKE ecosystem.
Contribute to team technical documentation,



create reusable platform templates ("paved paths"), and assist other engineers in adopting platform standards.
Execute on team technical roadmaps to improve platform reliability, lower operational overhead, and speed up delivery cycles for AI product features.

1. Skills and Experience Requirements1. AI Infrastructure & Generative AI Experience
Self-Hosted LLM Serving: Hands-on experience deploying, configuring, and scaling self-hosted Large Language Models (LLMs) on GKE using inference engines such as vLLM, NVIDIA NIM, or SGLang. Basic understanding of Kubernetes GPU allocation, multi-GPU nodes, and model execution requirements.
Cloud-Native AI Tools: Experience working with or integrating emerging cloud-native AI infrastructure tools and control planes such as Agentgateway or Kagent to support agentic workflows and request routing.
AI Agent & LLM Observability (OpenTelemetry): Practical experience co

📌 Platform Engineer III (Bengaluru)
🏢 CME Group
📍 Bengaluru