While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an setting that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi

Role: Lead/Associate Lead – QA + MLOps & Generative AI

Experience: 10+ years

Location: Mumbai/Bangalore (Hybrid)

Key Responsibilities

AI/ML & GenAI Testing Strategy (AWS Ecosystem)

Define testing approaches for AI systems built on AWS services such as:

• Amazon SageMaker
• Amazon Bedrock
• AWS Lambda
• Amazon API Gateway
• Amazon Kinesis
• AWS Glue
• Amazon S3
• Amazon CloudWatch

Design Validation Frameworks Covering

• Model accuracy & performance validation
• Data drift & concept drift detection
• Hallucination detection for LLMs
• Prompt robustness testing
• RAG validation (retrieval accuracy + grounding)
• Bias & fairness validation
• Safety & toxicity testing





MLOps Quality Engineering (AWS-Centric)

Validate The End-to-end ML Lifecycle Including

• Data ingestion & feature pipelines
• Model training & hyperparameter tuning
• Model versioning & registry
• Deployment validation
• Canary & blue/green release validation

Work With AWS-native Services Such As

• SageMaker Pipelines
• SageMaker Model Monitor
• SageMaker Feature Store
• Bedrock model evaluation workflows
• CloudWatch-based observability

Implement CI/CD quality gates for ML pipelines integrated with AWS DevOps tools.

GenAI & Agentic AI Testing

Define Quality Engineering Approaches For

• LLM-based applications using Amazon Bedrock
• Prompt engineering validation
• Multi-agent orchestration testing
• Chatbot & Voice bot conversational testing
• Intent classification validation
• Conversation drift & fallback validation
• API contract validation for LLM integrations

Build Reusable Evalu

📌 Associate Lead (Bengaluru)
🏢 Quantiphi
📍 Bengaluru