01 Oct
|
InfoCepts
|
Bengaluru
01 Oct
InfoCepts
Bengaluru
Purpose of the Position: The AI Platform Engineer- MLOps/LLMOps will be responsible for designing, implementing, and operationalizing enterprise-grade AI, Machine Learning, and Generative AI solutions. The role will focus on deploying and monitoring AI applications, establishing governance frameworks, and enabling secure, reliable, and cost-effective AI operations across cloud environments. The individual will provide technical leadership and drive best practices for AI engineering, MLOps, and LLMOps initiatives.
Key Result Areas and Activities:
- Reliability and Availability of AI services and solutions
- Design scalable AI/ML and Generative AI deployment architectures.
- Define enterprise standards for model deployment, monitoring, and lifecycle management.
- Design and operationalize RAG, agentic AI, prompt management, vector databases, and LLM integration frameworks.
- MLOps & LLMOps Implementation
- Establish CI/CD pipelines for machine learning and LLM-based applications.
- Automate model training, deployment, versioning, and rollback processes.
- Optimize LLM performance,
scalability, and cost efficiency including Inference cost management
- Model Governance & Reliability
- Implement frameworks for model monitoring, evaluation, drift detection, observability, and compliance.
- Ensure responsible AI and governance standards are followed.
- Technical Leadership & Stakeholder Collaboration
- Mentor AI engineers, junior platform engineers and data scientists.
- Collaborate with business and technology teams to translate AI use cases into production-ready solutions.
- Essential Skills:
- LLM serving and inference optimization and running an inference gateway that routes across providers and open-weight models with failover
- LLM observability and tracing: end-to-end request tracing through retrieval, prompt, tool calls and generation using LangSmith or Azure AI Foundry
- Evaluation as a platform capability: building the harness product teams use to regression-tes
📌 Hiring: Machine Learning (Bengaluru)
🏢 InfoCepts
📍 Bengaluru