07 Nov
|
Orcapod Consulting Services
|
Bengaluru
07 Nov
Orcapod Consulting Services
Bengaluru
10+ years of overall IT experience, with robust hands-on expertise in cloud infrastructure, DevOps, platform engineering, and enterprise application settings.
Robust hands-on experience with LiteLLM, including configuration and integration of LLM endpoints, model routing, gateways, and enterprise AI platform use cases.
Practical experience with Langfuse for LLM observability, tracing, monitoring, prompt management, and troubleshooting AI/LLM applications.
Hands-on experience with LibreChat, including deployment, configuration, integration with LLM providers, and production-grade operational support.
Strong knowledge of Microsoft Azure cloud infrastructure, including compute, networking, identity/access, security, storage, containers, and deployment of enterprise workloads.
Strong DevOps and CI/CD expertise,
preferably using Azure DevOps and/or GitHub, with experience in Infrastructure as Code, containerization, Docker, Kubernetes/AKS, automation, monitoring, and release management.
Experience building and operating secure, scalable, production-grade AI/LLM platforms, with good understanding of API integrations, authentication, secrets management, logging, monitoring, reliability, and troubleshooting.
Ability to work independently in an enterprise environment, collaborate with architecture, security, infrastructure, DevOps, and application teams, and take end-to-end ownership from solution design through deployment and operational support.
📌 Senior Ai Platform Engineer Bengaluru
🏢 Orcapod Consulting Services
📍 Bengaluru