About the Role :

We are hiring a Lead Platform Engineer to drive the architecture and evolution of our Enterprise AI Platform. This is a senior individual contributor role (no people management) where you will act as the technical anchor for the platform team, owning critical decisions and leading complex initiatives from design to production.

You will play a key role in building scalable, secure, and high-performance infrastructure for AI/ML systems used across enterprise environments.

Key Responsibilities :

- Define and drive the technical architecture for the AI platform, including cloud infrastructure, model serving, and developer tooling.
- Lead system design for core components like LLM gateway, model serving infrastructure, and multi-tenant systems.
- Own end-to-end delivery of large-scale platform initiatives.
- Act as the technical escalation point for complex engineering challenges.
- Establish best practices for reliability, observability, and performance (SLOs, monitoring, incident handling).
- Design and implement security and compliance frameworks (SOC2, GDPR, access control, audit logs).
- Collaborate with cross-functional teams (ML, Product, Security) to align platform capabilities.
- Drive engineering excellence through design reviews, documentation, and coding standards.

Required Skills :

- 8+ years of experience in Platform Engineering / Infrastructure / SRE.




- Robust expertise in Kubernetes (EKS/GKE/AKS).
- Hands-on experience with cloud platforms: AWS / GCP / Azure.
- Strong experience with Infrastructure as Code (Terraform or Pulumi).
- Experience with CI/CD and GitOps tools (ArgoCD, GitHub Actions).
- Proven experience designing and scaling distributed systems.
- Exposure to AI/ML infrastructure (model serving, inference pipelines, LLM integration).
- Strong understanding of networking, security, and multi-tenant architectures.
- Excellent problem-solving and system design skills.

Good to Have :

- Experience with vLLM, Triton, Ray Serve, MLflow.
- Knowledge of Kafka, Redis, PostgreSQL.
- Experience with observability tools (Prometheus, Grafana, OpenTelemetry).
- Exposure to GPU workloads and cost optimization (FinOps).
- Experience building Internal Developer Platforms (IDP).

Ideal Candidate :

- Staff / Lead / Principal Engineer from a product-based company.
- Strong ownership mindset with ability to drive initiatives independently.
- Experience working in high-scale, distributed environments.
- Excellent communication and ability to influence without authority.

Why Join Us :

- Work on cutting-edge AI platform infrastructure.
- High-impact role with end-to-end ownership.
- Remote-first culture with flexible work environment.
- Competitive compensation and growth opportunities.

📌 Lead Platform Engineer - Kubernetes (India)
🏢 Vipany Global Solutions
📍 India