? Job Title: AI Quality & Optimization Engineer

? Location: India - Remote

? Employment type: Full-time

? Environment: Consulting Setting

About the Role

We are searching on behalf of our client for this role. This position is not with OVI.

This role focuses on establishing quality standards for enterprise AI solutions while improving the performance, reliability, and cost efficiency of AI systems. The ideal candidate combines AI quality assurance practices with experience evaluating, monitoring, and optimizing AI applications in production.

Key Responsibilities

• Define QA standards, testing strategies, and quality gates for AI solutions.

• Build evaluation frameworks to assess AI model quality, accuracy, reliability, and safety.

• Validate AI applications through functional, performance, and regression testing.

• Identify and implement cost optimization opportunities across AI workloads and cloud infrastructure.

• Monitor AI system performance, quality metrics, and production health.

• Collaborate with AI, software,



and platform engineering teams to deliver production-ready AI solutions.

Core Requirements

• 3+ years of experience in AI, QA, Software Testing, Platform Engineering, or related roles.

• Experience defining QA processes, testing methodologies, and quality standards.

• Hands-on experience building AI evaluation and validation frameworks.

• Understanding of AI model performance, reliability, and production monitoring.

• Experience optimizing cloud and AI infrastructure for cost and operational efficiency.

• Proficiency in Python and familiarity with automation or testing frameworks.

• Familiarity with AWS and/or Azure cloud environments.

AI-Focused Experience

• Exposure to LLMs, SLMs, or Generative AI applications.

• Familiarity with open-source AI models and evaluation tools.

• Experience with observability, monitoring, and AI performance metrics.

• Understanding of CI/CD pipelines and DevOps practices for AI deployments.

I

📌 AI Quality (India)
🏢 OVI
📍 India