Role Overview

At present, we have two AI/ML Test Engineer (AWS/GCP) Individual Contributor positions open and would welcome suitable candidate submissions for these opportunities.

Key Responsibilities
Design and execute test strategies for AI/ML applications and data pipelines.
Validate machine learning model performance, accuracy, robustness, and reliability.
Perform functional, integration, regression, API, and end-to-end testing.
Develop and maintain automated test frameworks using Python and contemporary testing tools.
Test AWS-based AI/ML solutions, including SageMaker and Bedrock deployments.
Verify data quality, model inputs/outputs, and ETL processes.
Conduct performance, security, and scalability testing.
Monitor production AI systems for model drift and performance degradation.
Collaborate closely with Data Scientists, ML Engineers, Developers, and DevOps teams.

Required Skills
Solid experience in Software Testing and Test Automation.
Proficiency in Python and SQL.
Experience with Selenium, Playwright, PyTest, or Robot Framework.




Positive understanding of Machine Learning concepts and model lifecycle.
Hands-on experience with AWS services such as EC2, S3, Lambda, SageMaker, and CloudWatch.
Experience in API testing using Postman or REST Assured.
Understanding of CI/CD pipelines and DevOps practices.

Preferred Skills
Experience testing Generative AI solutions and Large Language Models (LLMs).
Knowledge of AWS Bedrock, MLOps, and Responsible AI practices.
Exposure to performance testing tools and cloud-native testing approaches.
Familiarity with Agile/Scrum methodologies.

Skills: aws – ec2, s3, lambda,selenium / playwright,aws sagemaker,test automation,functional, integration, regression & e2e testing,ci/cd & devops practices,ai/ml application testing,pytest / robot framework,data quality & etl testing,sql,performance, security & scalability testing,aws cloudwatch,machine learning concepts & model lifecycle,api testing – postman / rest assured,python

📌 Ai/ml Test Engineer Aws/gcp Bengaluru (India)
🏢 Aarushi Infotech
📍 India