- 10+ years of overall IT experience, with strong hands-on expertise in cloud infrastructure, DevOps, platform engineering, and enterprise application environments.

- Robust hands-on experience with LiteLLM, including configuration and integration of LLM endpoints, model routing, gateways, and enterprise AI platform use cases.

- Practical experience with Langfuse for LLM observability, tracing, monitoring, prompt management, and troubleshooting AI/LLM applications.

- Hands-on experience with LibreChat, including deployment, configuration, integration with LLM providers, and production-grade operational support.

- Strong knowledge of Microsoft Azure cloud infrastructure, including compute, networking, identity/access, security, storage, containers, and deployment of enterprise workloads.

- Strong DevOps and CI/CD expertise,



preferably using Azure DevOps and/or GitHub, with experience in Infrastructure as Code, containerization, Docker, Kubernetes/AKS, automation, monitoring, and release management.

- Experience building and operating secure, scalable, production-grade AI/LLM platforms, with good understanding of API integrations, authentication, secrets management, logging, monitoring, reliability, and troubleshooting.

- Ability to work independently in an enterprise environment, collaborate with architecture, security, infrastructure, DevOps, and application teams, and take end-to-end ownership from solution design through deployment and operational support.

📌 Senior AI Platform Engineer (Bengaluru)
🏢 Orcapod Consulting Services
📍 Bengaluru