AI QUALITY ENGINEER

- Job Title : AI Quality Engineer

- Location : Hybrid ( 66% On-site )

- Employment Type : Full-Time

- Experience :2 - 4 Years**:

- Department : Engineering

About Smarter.Codes

Smarter.Codes is an AI Startup Studio with 12 years of experience building AI-powered products. Our work has been adopted by organizations including the US Airforce, Johnson & Johnson, SGS Group, Finland Government , and thousands of SMBs worldwide.

Beyond building startups for clients, we are actively investing in our own ventures focused on:

- Developer Tools for AI Entrepreneurs :

- Vertical AI Products :

- Horizontal AI Solutions :

- AI Infrastructure :

- B2C Startups

Role Overview

We are seeking a detail-oriented and analytical AI Quality Engineer to build and scale quality systems for AI-powered software products .

This is not a traditional manual QA role . The position combines:

- Automation Engineering :

- AI Evaluation & Benchmarking :

- Document Fidelity Testing :

- Product Quality Strategy :

- Functional & Regression Testing

You will play a key role in ensuring our products are reliable, accurate, scalable, and enterprise-grade .

Key ResponsibilitiesSoftware & Product Quality

- Design, execute, and maintain test cases for Web Applications, APIs, and AI-driven Systems :

- Perform Functional Testing and Regression Testing :

- Ensure product Consistency, Reliability, Usability, and Performance

AI Evaluation & Validation

- Validate AI-generated outputs using scoring systems and benchmarking methodologies
- Conduct Semantic and Logical Validation of AI responses
- Evaluate quality, accuracy, and consistency of AI-generated content

Automation & Engineering

- Develop and maintain Automation Testing Scripts and Frameworks using Python :

- Support quality validation within CI/CD Pipelines :

- Collaborate with engineering teams to identify and resolve defects

Documentation & Analysis

- Create Task Analysis Stories :





- Maintain structured QA documentation

- Analyze product behavior and proactively recommend quality improvements

Required Skills & QualificationsTechnical Skills

✔ Strong understanding of Software Testing Fundamentals

✔ Experience with API Testing and Regression Testing

✔ Familiarity with Automation Testing Frameworks

✔ Proficiency in Python Scripting for Testing and Automation

✔ Experience validating Complex Document Formats

✔ Familiarity with CI/CD Pipelines and Quality Validation Processes

✔ Understanding of Structured Data Validation Techniques

✔ Knowledge of AI Evaluation Methodologies and Benchmarking Concepts

Valuable to Have

- Experience with Document Parsing Libraries :

- Familiarity with DOCX and PDF Rendering Systems :

- Experience working with Enterprise SaaS Products :

- Exposure to AI Products or LLM-based Systems :

- Knowledge of Prompt Engineering :

- Familiarity with Selenium or Playwright

Desired Traits

- Ownership Mindset with accountability for outcomes

- Strong Documentation and Reporting Skills :

- "Question Everything" approach to validation and problem-solving

- Ability to thrive in a Quick-Paced Startup Environment

Compensation₹6 LPA - ₹9 LPA+ ( Subject to performance during the selection process )

Why Join Us?

Build products that are shaping the future of AI

Work on Vertical AI, Horizontal AI, and AI Infrastructure

Gain exposure to multiple startups and product environments

Opportunity to grow from a Contributor to a Future Co-Founder

Be part of building the next generation of world-class AI companies

Ability to commute/relocate:

- Panchkula, Haryana (Panchkula): Reliably commute or planning to relocate before starting work (preferred)

Application Question(s):

- Do you have hands-on experience with automation testing? If yes, please specify your total years of experience in this area.
- Please share your current CTC and your expected CTC for this opportunity.

Work Location: Hybrid remote in Panchkula, Haryana (Panchkula)

📌 Ai Quality Engineer (Panchkula)
🏢 Smarter.Codes
📍 Panchkula