We are looking for an experienced AI/ML Model Evaluation & Strategy Lead who can combine deep technical expertise in machine learning and AI with strong strategic and stakeholder management capabilities.

The ideal candidate will be responsible for model evaluation, benchmarking, AI/ML experimentation, LLM/RAG prototyping, MLOps, and AI quality frameworks, while also working closely with business and technology stakeholders to translate technical findings into strategic decisions.

This is a technical-strategy hybrid role, requiring hands-on experience in AI/ML along with the ability to lead cross-functional initiatives and influence strategic outcomes.

Key Responsibilities

- Design and implement evaluation and benchmarking frameworks for LLMs, computer vision, predictive ML, and classical ML models.
- Define evaluation metrics covering accuracy, fairness, scalability, reliability, latency, and cost.
- Conduct hands-on experimentation with LLMs, transformer architectures, RAG systems, and AI/ML models.
- Build prototypes and proof-of-concepts using Python, TensorFlow, PyTorch, and Hugging Face.
- Develop and optimize data pipelines for AI/ML workloads using ETL, Spark, Kafka, and feature engineering.
- Implement MLOps practices using MLflow/Kubeflow, Docker, and Kubernetes.




- Deploy and manage AI/ML solutions on AWS, GCP, or Azure in production environments.
- Analyze model performance and translate technical evaluation results into actionable business recommendations.
- Partner with engineering, product, strategy, and business teams to drive AI initiatives.
- Lead cross-functional strategic initiatives and provide technical guidance to junior Strategy & Execution team members.
- Establish best practices for AI quality assurance, model governance, evaluation, and deployment.

Preferred Experience

- Experience in AI/ML model evaluation and benchmarking.
- Experience with LLM evaluation, RAG systems, AI quality assurance, or ML platforms.
- Solid understanding of LLM/Transformer architectures.
- Experience taking AI/ML models from experimentation through production deployment.
- Experience working with enterprise stakeholders and translating technical insights into business decisions.
- Experience leading cross-functional strategic initiatives.

Candidate Profile

Ideal candidates may come from backgrounds such as:

- AI/ML Model Evaluation
- MLOps
- AI Quality Assurance
- RAG/LLM Engineering
- Machine Learning Platforms
- AI/ML Strategy & Consulting

📌 AI/ML Model Evaluation (Bengaluru)
🏢 IFINSOL GLOBAL PRIVATE
📍 Bengaluru