Title of Job: GenAI DevOps / Platform Engineer

Job Type: Permanent

Location: Bangalore, Pune, Gurgaon

Job Ref: 141416

Published: about 9 hours ago

Contact Name: Sadaf Zenab

Contact Email: [email protected]

Summary We are looking for an experienced GenAI DevOps / Platform Engineer who can drive the deployment and operationalisation of Generative AI and LLM-based applications from development or proof-of-concept environments into secure, scalable, reliable, and production-ready environments.

The ideal candidate will have strong hands-on experience in cloud infrastructure, DevOps automation, CI/CD pipelines, containerisation, and production deployment, along with a solid understanding of GenAI application architecture, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG). The role requires strong technical ownership, troubleshooting capabilities, and the ability to ensure seamless production operations.

Your Future Employer A leading organisation in the Financial Services industry, offering an opportunity to work on cutting-edge Generative AI technologies and enterprise-scale platforms. You will contribute towards building secure, scalable, and production-ready GenAI solutions while driving cloud transformation and technological innovation.

Responsibilities

- Design, deploy, and manage GenAI/LLM-based applications in production environments, ensuring scalability, reliability, performance, and availability.
- Build and maintain CI/CD pipelines for application and model deployment while implementing infrastructure automation using Terraform or other Infrastructure-as-Code tools.
- Manage cloud infrastructure across AWS, Microsoft Azure, or GCP,



including containerisation and orchestration using Docker and Kubernetes, along with secure deployment practices, IAM, secrets management, and cloud networking.
- Support GenAI application components, including LLM APIs, embeddings, vector databases, RAG pipelines, application orchestration, API gateways, and model integrations while establishing effective monitoring, logging, and observability.
- Troubleshoot application and infrastructure issues, conduct root-cause analysis, provide production support, maintain technical documentation, and collaborate with cross-functional teams while mentoring team members.

Requirements

- Robust hands-on experience with at least one major cloud platform, including AWS, Microsoft Azure, or GCP, with proven experience deploying and operating GenAI or LLM-based applications in production environments.
- Strong knowledge of Docker, Kubernetes, Terraform or other Infrastructure-as-Code tools, CI/CD pipelines, Git, Linux, cloud networking, IAM, and secrets management.
- Experience supporting applications developed using Python, FastAPI, or comparable API/backend technologies, along with a sound understanding of modern GenAI application architecture, LLM APIs, prompt orchestration, RAG, embeddings, and vector databases.
- Experience managing production systems with defined availability,



performance, security, and recovery requirements, along with strong troubleshooting skills across application and infrastructure layers.
- Understanding of LLMOps and MLOps practices, enterprise security, regulatory requirements, and data governance.

Experience with Azure OpenAI, Amazon Bedrock, OpenAI APIs, Hugging Face, vLLM, NVIDIA Triton, or vector platforms is preferred. Banking or Financial Services experience will be an added advantage.

What Is in It for You

- Opportunity to work on cutting-edge Generative AI and LLM-based applications.
- Exposure to enterprise-scale cloud platforms and modern DevOps technologies.
- Opportunity to take innovative GenAI products from proof-of-concept to production.
- Work with advanced technologies across LLMOps, MLOps, RAG, Kubernetes, and cloud automation.
- Opportunity to demonstrate technical leadership, production ownership, and cross-functional collaboration.
- Be part of a technology-driven environment focused on innovation, scalability, and operational excellence.

Reach Us If you think this role is aligned with your career, kindly write me an email along with your updated CV on [email protected] for a confidential discussion on the role.

Disclaimer Crescendo Global specializes in Senior to C-level niche recruitment. We are passionate about empowering job seekers and employers with an engaging, memorable job search and leadership hiring experience.

Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

📌 Sr Devops Cloudplus Years-Bangalore / gurgaon job in (India)
🏢 Crescendo Global
📍 India