Cloud Engineer II- AI

Location: This is a hybrid opportunity in Delhi NCR, Hyderabad, Bangalore, Pune.

Role Overview

As a Cloud AI Engineer II, you will be responsible for leading the architecture, design, and delivery of enterprise-scale AI/ML and Generative AI cloud platforms. You will drive technical strategy, establish engineering standards, mentor teams, and deliver secure, scalable, reliable, and cost-optimized AI infrastructure across multi-cloud environments including AWS, Azure, and GCP.

This role requires a strong combination of cloud architecture, AI/ML platform engineering, Kubernetes, MLOps, GenAI solution design, infrastructure automation, security governance, and hands-on experience deploying production-grade AI workloads.

Key Roles and Responsibilities

- Architect enterprise-scale AI/ML infrastructure across AWS, Azure, and Google Cloud Platform, ensuring high availability, scalability, performance, and cost efficiency.
- Lead the design and implementation of cloud infrastructure standards, governance frameworks, security controls, and technical best practices for AI/ML platforms.
- Design scalable Kubernetes-based platforms and self-service environments that enable ML, data science, and application teams to build, deploy, and manage AI workloads independently.
- Architect Generative AI, Retrieval-Augmented Generation, vector database, and LLM deployment solutions using frameworks and tools such as LangChain, CrewAI,



LlamaIndex, OpenAI-compatible APIs, and enterprise AI services.
- Very good understanding of Microsoft Foundry
- Build and manage production-grade MLOps and LLMOps pipelines for model training, deployment, monitoring, versioning, evaluation, and continuous improvement.
- Design cloud-native solutions for AI workloads using containerization, orchestration, serverless computing, GPU/accelerator-based compute, managed ML services, and distributed processing frameworks.

Required Skills and Technical Expertise
- Strong hands-on experience with cloud platforms such as AWS, Microsoft Azure, and Google Cloud Platform.
- Hands-on experience with GenAI frameworks and orchestration tools such as LangChain, CrewAI, LlamaIndex, Semantic Kernel, or similar frameworks.
- Experience designing RAG pipelines, embedding workflows, document ingestion pipelines, prompt orchestration, vector search, and enterprise knowledge retrieval solutions.
- Strong understanding of LLM deployment patterns, model serving, inference optimization, prompt engineering, evaluation frameworks, guardrails, and responsible AI controls.
- Solid scripting and programming skills in Python, Bash, PowerShell, or similar languages, with the ability to build automation and integration solutions.
- Ability to work with APIs, data models, and external toolchains across complex systems.

📌 Cloud Engineer II -AI (Gurugram)
🏢 Insight Direct India
📍 Gurugram