Role Overview

At present, we have two AI/ML Test Engineer (AWS/GCP) Individual Contributor positions open and would welcome suitable candidate submissions for these opportunities.

Key Responsibilities

- Design and execute test strategies for AI/ML applications and data pipelines.

- Validate machine learning model performance, accuracy, robustness, and reliability.

- Perform functional, integration, regression, API, and end-to-end testing.

- Develop and maintain automated test frameworks using Python and modern testing tools.

- Test AWS-based AI/ML solutions, including SageMaker and Bedrock deployments.

- Verify data quality, model inputs/outputs, and ETL processes.

- Conduct performance, security, and scalability testing.

- Monitor production AI systems for model drift and performance degradation.

- Collaborate closely with Data Scientists, ML Engineers, Developers, and DevOps teams.

Required Skills

- Strong experience in Software Testing and Test Automation.

- Proficiency in Python and SQL.

- Experience with Selenium, Playwright, PyTest, or Robot Framework.





- Positive understanding of Machine Learning concepts and model lifecycle.

- Hands-on experience with AWS services such as EC2, S3, Lambda, SageMaker, and CloudWatch.

- Experience in API testing using Postman or REST Assured.

- Understanding of CI/CD pipelines and DevOps practices.

Preferred Skills

- Experience testing Generative AI solutions and Large Language Models (LLMs).

- Knowledge of AWS Bedrock, MLOps, and Responsible AI practices.

- Exposure to performance testing tools and cloud-native testing approaches.

- Familiarity with Agile/Scrum methodologies.

Skills: aws – ec2, s3, lambda,selenium / playwright,aws sagemaker,test automation,functional, integration, regression & e2e testing,ci/cd & devops practices,ai/ml application testing,pytest / robot framework,data quality & etl testing,sql,performance, security & scalability testing,aws cloudwatch,machine learning concepts & model lifecycle,api testing – postman / rest assured,python

📌 AI/ML Test Engineer (AWS/GCP) (Bengaluru)
🏢 Aarushi Infotech
📍 Bengaluru