? Job Title: Open-Source LLM/SLM Specialist
? Location: India - Remote
? Employment type: Full time
? Environment: Consulting
About the Role
We are searching on behalf of our client for this role. This position is not with OVI.
This role focuses on developing, fine-tuning, evaluating, and deploying open-source Large Language Models (LLMs) and Small Language Models (SLMs) for enterprise AI applications. The ideal candidate will have hands-on experience building production-ready AI solutions using open-source models, with a strong understanding of private and on-premise deployments.
Key Responsibilities
• Fine-tune and optimize open-source LLMs and SLMs for enterprise use cases.
• Design and execute model evaluation, benchmarking, and performance testing.
• Deploy and manage models across cloud, private, or on-premise environments.
• Build inference pipelines and optimize models for performance and scalability.
• Collaborate with AI engineers and data teams to integrate models into production applications.
• Ensure model security, monitoring, and operational reliability.
Core Requirements
• 3+ years of experience in AI/ML Engineering or related software engineering roles.
• Hands-on experience training and fine-tuning open-source LLMs or SLMs.
• Experience with model evaluation, optimization, and deployment.
• Proficiency in Python and modern AI/ML development frameworks.
• Understanding of model serving, inference, and production deployment best practices.
• Familiarity with GPU-based environments and scalable AI infrastructure.
AI-Focused Experience
• Experience working with open-source models such as Llama, Mistral, Qwen, Gemma, or similar.
• Hands-on experience deploying models in private, secure, or on-premise environments.
• Familiarity with Hugging Face, vLLM, Ollama, or similar open-source AI ecosystems.
• Exposure to model quantization, optimization, or inference acceleration is preferred.
• Understanding of enterprise AI security an
📌 Open-Source LLM/SLM Specialist (India)
🏢 OVI
📍 India