Company Name: VARITE India Private Limited

About The Client

An Indian multinational information technology (IT) consulting company headquartered in Noida, The company has offices in 52 countries and over 225,944 employees. The Client is a global IT services and consulting company that offers a wide range of services and products across various industries like IT Infrastructure Services, Cybersecurity Services, Cloud Services, Big Data and Analytics, Internet of Things (IoT) Solutions, Semiconductor Services and Enterprise Software Products.

About The Job:

- We are looking for an experienced AI Quality Engineer to define and implement testing strategies for AI/ML applications across cloud and edge environments.

- This role involves test automation, model quality validation, system reliability testing, and performance benchmarking.

- You will work closely with developers, data scientists, and DevOps engineers to ensure AI-powered systems are robust, explainable, and production-ready.

Essential Job Functions:

AI Testing & Automation

- Design and implement automated test frameworks for AI/ML pipelines (training, inference, monitoring).

- Validate model accuracy, robustness, drift, and bias across datasets.

- Develop test suites for edge AI inference, cloud deployments, and hybrid pipelines.

- Automate data validation pipelines (quality, integrity, lineage).

- Implement regression testing for AI models after retraining.

Edge & Cloud Testing

- Conduct performance, latency, and throughput testing of AI inference on cloud (AWS, Azure, GCP) and edge devices (NVIDIA Jetson, Coral TPU, ARM devices).

- Benchmark models across different hardware accelerators (CPU, GPU, TPU, NPU).

- Test OTA updates for AI models on edge devices.

- Validate resiliency, failover, and network reliability in edge–cloud AI pipelines.

System Quality & Compliance

- Define quality metrics for AI models (precision, recall, F1, robustness under adversarial attacks).

- Ensure AI systems meet governance, fairness, and ethical AI standards.





- Conduct security testing for model APIs and inference pipelines.

- Validate compliance with GDPR, HIPAA, SOC2 for data and AI systems.

Collaboration & Tooling

- Work with MLOps teams to integrate quality gates into CI/CD pipelines.

- Collaborate with data scientists to build reproducible model testing environments.

- Partner with DevOps/AI Ops teams for continuous monitoring and anomaly detection.

- Leverage synthetic data generation to expand test coverage.

Qualifications

Testing & QA Skills

- Strong background in test automation frameworks (PyTest, Robot Framework, Selenium, Playwright).

- Experience with API testing (Postman, REST Assured, Karate).

- Hands-on with performance testing tools (Locust, JMeter, k6).

- Familiarity with security testing tools (OWASP ZAP, Burp Suite).

AI/ML Testing Skills

- Knowledge of model evaluation metrics (ROC, AUC, F1-score, confusion matrix).

- Experience validating computer vision, NLP, and multimodal AI models.

- Tools for model validation: Evidently AI, WhyLabs, Arize AI, Fiddler AI.

- Familiarity with adversarial testing frameworks (Foolbox, ART – Adversarial Robustness Toolbox).

Cloud & Edge Testing Skills

- Cloud AI services: AWS SageMaker, Azure ML, GCP Vertex AI.

- Edge AI platforms: NVIDIA Jetson, OpenVINO, TensorRT, TFLite, CoreML.

- Strong understanding of distributed systems testing.

- Knowledge of IoT/edge device testing frameworks.

General Engineering Skills

- Programming: Python (must), Bash, Java/Go (nice-to-have).

- CI/CD: GitHub Actions, Jenkins, GitLab CI.

- Containerization: Docker, Kubernetes.

- Observability: Prometheus, Grafana, ELK, OpenTelemetry.

Experience Required

- 5–7 years in QA/Automation testing,



with at least 2+ years in AI/ML systems testing.

- Hands-on testing of AI applications in production (cloud and edge).

- Proven track record in building automated test frameworks for AI/ML pipelines.

- Experience working in Agile/Scrum AI/ML product teams.

Nice-to-Have

- Knowledge of federated learning testing scenarios.

- Experience with synthetic data & simulation environments (Unity, Unreal Engine).

- Publications or contributions to AI testing frameworks/tools.

- Understanding of Responsible AI testing frameworks.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

0-2 years

INR 5,000

2-6 years

INR 7,500

6+ years

INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer:

VARITE is an equal prospect employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.

📌 AI QA Engineer (Noida)
🏢 VARITE
📍 Noida