We are looking for an experienced AI/ML Model Evaluation & Strategy Lead who can combine deep technical expertise in machine learning and AI with solid strategic and stakeholder management capabilities.

The ideal candidate will be responsible for model evaluation, benchmarking, AI/ML experimentation, LLM/RAG prototyping, MLOps, and AI quality frameworks, while also working closely with business and technology stakeholders to translate technical findings into strategic decisions.

This is a technical-strategy hybrid role, requiring hands-on experience in AI/ML along with the ability to lead cross-functional initiatives and influence strategic outcomes.

Key Responsibilities
Design and implement evaluation and benchmarking frameworks for LLMs, computer vision, predictive ML, and classical ML models.
Define evaluation metrics covering accuracy, fairness, scalability, reliability, latency, and cost.
Conduct hands-on experimentation with LLMs, transformer architectures, RAG systems, and AI/ML models.
Build prototypes and proof-of-concepts using Python, TensorFlow, PyTorch, and Hugging Face.
Develop and optimize data pipelines for AI/ML workloads using ETL, Spark, Kafka, and feature engineering.
Implement MLOps practices using MLflow/Kubeflow, Docker, and Kubernetes.




Deploy and manage AI/ML solutions on AWS, GCP, or Azure in production settings.
Analyze model performance and translate technical evaluation results into actionable business recommendations.
Partner with engineering, product, strategy, and business teams to drive AI initiatives.
Lead cross-functional strategic initiatives and provide technical guidance to junior Strategy & Execution team members.
Establish best practices for AI quality assurance, model governance, evaluation, and deployment.

Preferred Experience
Experience in AI/ML model evaluation and benchmarking.
Experience with LLM evaluation, RAG systems, AI quality assurance, or ML platforms.
Solid understanding of LLM/Transformer architectures.
Experience taking AI/ML models from experimentation through production deployment.
Experience working with enterprise stakeholders and translating technical insights into business decisions.
Experience leading cross-functional strategic initiatives.

Candidate Profile

Ideal candidates may come from backgrounds such as:
AI/ML Model Evaluation
MLOps
AI Quality Assurance
RAG/LLM Engineering
Machine Learning Platforms
AI/ML Strategy & Consulting

📌 Ai/ml Model Evaluation Bengaluru
🏢 IFINSOL GLOBAL PRIVATE
📍 Bengaluru