Client is a global leader in next-generation digital services and consulting
About The Job:
- We are seeking a Platform Engineer to join our team and lead the deployment of a Teams chatbot powered by a Large Language Model (LLM).
- This role focuses on designing, implementing, and maintaining the infrastructure required to host and scale the chatbot.
- While familiarity with LLMs is a plus, the core responsibility is ensuring robust architecture, security, and production readiness.
Essential Job Functions:
- Architecture & Design
- Design and implement cloud-native architecture for hosting the chatbot on Azure (or AWS).
- Integrate the chatbot with Microsoft Teams using Bot Framework SDK and Azure Bot Service.
- Deployment & Operations
- Build CI/CD pipelines for automated deployment and updates.
- Containerize applications using Docker and orchestrate with Kubernetes (Azure Kubernetes Service (AKS) or Elastic Kubernetes Service (EKS)).
- Manage infrastructure as code.
- Security & Compliance
- Implement authentication and authorization.
- Ensure compliance with data privacy and security standards.
- Monitoring & Maintenance
- Set up observability tools (e.g., Azure Monitor or CloudWatch).
- Implement logging, alerting, and performance monitoring.
- Optimize cost and resource utilization.
- Collaboration
- Work closely with Data Scientists and ML Engineers to integrate LLM APIs/models.
- Provide guidance on best practices for deploying AI workloads in production
Qualifications:
- Total Experience 5+ Years
- Relevant Experience 5+ Years