While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an workplace that encourages you to innovate and excel, not just in qualified but personal life, interests you- you would enjoy your career with Quantiphi
Role: Lead/Associate Lead – QA + MLOps & Generative AI
Experience: 10+ years
Location: Mumbai/Bangalore (Hybrid)

Key Responsibilities:
AI/ML & GenAI Testing Strategy (AWS Ecosystem)
Define testing approaches for AI systems built on AWS services such as:
Amazon SageMaker
Amazon Bedrock
AWS Lambda
Amazon API Gateway
Amazon Kinesis
AWS Glue
Amazon S3
Amazon CloudWatch

Design validation frameworks covering:
Model accuracy & performance validation
Data drift & concept drift detection
Hallucination detection for LLMs
Prompt robustness testing
RAG validation (retrieval accuracy + grounding)
Bias & fairness validation
Safety & toxicity testing





MLOps Quality Engineering (AWS-Centric)
Validate the end-to-end ML lifecycle including:
Data ingestion & feature pipelines
Model training & hyperparameter tuning
Model versioning & registry
Deployment validation
Canary & blue/green release validation

Work with AWS-native services such as:
SageMaker Pipelines
SageMaker Model Monitor
SageMaker Feature Store
Bedrock model evaluation workflows
CloudWatch-based observability

Implement CI/CD quality gates for ML pipelines integrated with AWS DevOps tools.

GenAI & Agentic AI Testing
Define quality engineering approaches for:
LLM-based applications using Amazon Bedrock
Prompt engineering validation
Multi-agent orchestration testing
Chatbot & Voice bot conversational testing
Intent classification validation
Conversation drift & fallback validation
API contract validation for LLM integrations

Build reusable evaluation h

📌 Associate Lead Bengaluru
🏢 Quantiphi
📍 Bengaluru