An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.
About The Job:
- As an LLMOps Engineer, you will play a crucial role in the deployment, maintenance, and optimization of large language models (LLMs).
- Your responsibilities will span the entire lifecycle of LLMs, from initial deployment to ongoing operations, ensuring optimal performance, scalability, and reliability.
Essential Job Functions:
- LLM Deployment and Integration
- Deploy and integrate large language models into production environments, ensuring seamless integration with existing systems and applications.
- Infrastructure Planning and Scaling
- Collaborate with cross-functional teams to plan and design the infrastructure required for LLM deployment.
- Implement scalable solutions to accommodate growing data volumes and user loads.
- Automation of Deployment Processes
- Develop and maintain automation scripts and tools for productive deployment, scaling, and versioning of LLMs.
- Streamline deployment processes to minimize downtime.
- Continuous Monitoring and Alerting
- Implement monitoring systems to track LLM performance metrics.
- Set up alerts for potential issues and respond promptly to ensure uninterrupted service.
- Performance Monitoring and Optimization
- Monitor the performance of LLMs in real-time, conduct regular assessments, and implement optimizations to enhance efficiency and responsiveness.
- Fault Tolerance and Disaster Recovery
- Design and implement fault-tolerant systems for LLMs, incorporati
📌 LLM Ops (Bengaluru)
🏢 VARITE
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.