Description
Role Overview
As a Test Automation Lead at Dailoqa, you'll architect and implement robust testing frameworks for both software and AI/ML systems. You'll bridge the gap between traditional QA and AI‐specific validation, ensuring seamless integration of automated testing into CI/CD pipelines while addressing unique challenges like model accuracy, GenAI output validation, and ethical AI compliance.
Key Responsibilities
Test Automation Strategy & Framework Design
• Design and implement scalable test automation frameworks for frontend (UI/UX), backend APIs, and AI/ML model‐serving endpoints using tools like Selenium, Playwright, Postman, or custom Python/Java solutions.
• Build GenAI‐specific test suites for validating prompt outputs, LLM‐based chat interfaces, RAG systems, and vector search accuracy.
• Develop performance testing strategies for AI pipelines (e.g., model inference latency, resource utilization).
Continuous Testing & CI/CD Integration
• Establish and maintain continuous testing pipelines integrated with GitHub Actions, Jenkins, or GitLab CI/CD.
• Implement shift‐left testing by embedding automated checks into development workflows (e.g., unit tests, contract testing).
AI/ML Model Validation
• Collaborate with data scientists to test AI/ML models for accuracy, fairness, stability, and bias mitigation using tools like TensorFlow Model Analysis or MLflow.
• Validate model drift and retraining pipelines to ensure consistent performance in production.
Quality Metrics & Reporting
• Define and track KPIs.
• Test coverage (code, data, scenarios)
• Defect leakage rate
• Automation ROI (time saved vs. maintenance effort)
• Model accuracy thresholds
• Report risks and quality trends to stakeholders in sprint reviews.
• Drive adoption of AI‐specific testing tools (e.g., LangChain for LLM testing, Outstanding Expectations for data validation).
Soft Skills
• Strong problem‐solving skills for balancing speed and quality in fast‐paced AI development.
•
📌 Software Testing Lead (Noida)
🏢 Saarthi
📍 Noida