Key Responsibilities Design build and maintain scalable and reliable cloud infrastructure across AWS Azure GCP and Alibaba Cloud to support AI Gateway and AI services Develop and implement automation tools and frameworks for infrastructure deployment and governance Collaborate with software engineering teams to ensure the infrastructure is scalable resilient and costeffective Manage model hosting for both opensource and cloudbased LLMs Create and maintain comprehensive documentation for systems and processes Participate in L2 oncall rotations and incident response activities Conduct postmortem analyses to identify root causes of outages and implement preventive measures Advocate for and implement best practices in infrastructure design and implementation for future AI solutions Qualifications Bachelors degree in Computer Science Engineering or a related field Proven experience as an Infrastructure Engineer or in a similar role Strong knowledge of cloud platforms AWS Azure GCP Alibaba Cloud etc Proficiency in scripting and programming languages such as Python Go or Java Handson experience with containerization and orchestration tools eg Docker Kubernetes Understanding of natural language processing NLP technologies including LangChain Familiarity with AI Gateway and API Gateway concepts preferably within the banking or financial services industry Solid understanding of networking concepts and protocols Excellent problemsolving skills with a proactive approach Solid communication and collaboration skills with the ability to work effectively with both technical and nontechnical stakeholders Commitment to maintaining high standards of data privacy and security