Company Name: VARITE India Private Limited

About The Client

An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.

About The Job:

- As an LLMOps Engineer, you will play a crucial role in the deployment, maintenance, and optimization of large language models (LLMs).

- Your responsibilities will span the entire lifecycle of LLMs, from initial deployment to ongoing operations, ensuring optimal performance, scalability, and reliability.

Essential Job Functions:

- LLM Deployment and Integration

- Deploy and integrate large language models into production environments, ensuring seamless integration with existing systems and applications.

- Infrastructure Planning and Scaling

- Collaborate with cross-functional teams to plan and design the infrastructure required for LLM deployment.

- Implement scalable solutions to accommodate growing data volumes and user loads.

- Automation of Deployment Processes

- Develop and maintain automation scripts and tools for productive deployment, scaling, and versioning of LLMs.

- Streamline deployment processes to minimize downtime.

- Continuous Monitoring and Alerting

- Implement monitoring systems to track LLM performance metrics.

- Set up alerts for potential issues and respond promptly to ensure uninterrupted service.

- Performance Monitoring and Optimization

- Monitor the performance of LLMs in real-time, conduct regular assessments, and implement optimizations to enhance efficiency and responsiveness.





- Fault Tolerance and Disaster Recovery

- Design and implement fault-tolerant systems for LLMs, incorporating strategies such as redundancy, sharding, and replication.

- Develop and maintain disaster recovery plans.

- Security Measures Implementation

- Implement robust security measures to safeguard LLMs and associated data.

- Ensure compliance with data security regulations and industry standards.

- Collaboration with NLP Engineers and Data Scientists

- Collaborate with NLP (Natural Language Processing) engineers and data scientists to understand model requirements and implement necessary infrastructure adjustments.

Qualifications

- Experience

- 7-12 Years

- Infrastructure as Code (IaC)

- Experience with IaC tools such as Terraform or Ansible for automating infrastructure provisioning.

- Containerization and Orchestration

- Proficiency in containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes) for managing LLM deployments.

- Cloud Platforms

- Familiarity with cloud platforms such as AWS (Bedrock), Azure, or GCP, and experience in deploying and managing applications in a cloud environment.

- Monitoring and Logging Tools

- Knowledge of monitoring tools (e.g., Prometheus, Grafana) and logging systems (e.g., ELK stack) for real-time performance monitoring and analysis.

- Security Measures

- Understanding of security guardrails using tools like LLM Guard and familiarity of how to mask / redact / obfuscate sensitive data,



protect the input and output of toxic and harmful content to / from LLMs and understand the performance implications of the same.

- Scripting and Automation

- Proficient in scripting languages such as Python, Shell, or similar, and experience in automating deployment and maintenance processes.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this prospect, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

0-2 years

INR 5,000

2-6 years

INR 7,500

6+ years

INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.

📌 LLM Ops (Bengaluru)
🏢 VARITE
📍 Bengaluru