Staff Test Engineer - AI (Bengaluru)

Staff Test Engineer - AI (Bengaluru)

19 Nov
|
Tally Solutions
|
Bengaluru

19 Nov

Tally Solutions

Bengaluru

Why Tally? / Why Join Us?

At Tally, we are driven by a straightforward yet powerful philosophy — hire for attitude, train for skills, and develop for leadership. With over 40 years of excellence and a leadership position in the Business Management Software platform leader for SMBs, we continue to innovate at the core of technology.

What sets us apart:

A strong culture of innovation and ownership.

Deep investment in foundational technology (including our own database, memory manager, and application language).

A fast-growing global presence.

A mission to impact hundreds of millions of businesses worldwide.

To know more about us, you can visit: https://tallysolutions.com/

Role: Staff Test Engineer/ Senior Staff Test Engineer

Relevant Experience: 8 – 12 years

Location: Bangalore

What We’re Looking For

Technical & Quality Engineering

Strong test design skills, with the ability to turn complex requirements into risk-based scenarios covering edge,

negative, concurrency, and failure cases.

Strong programming skills in Python, JavaScript, or similar, for building test automation, tools, and utilities.

Experience designing scalable automation frameworks (UI/API) from scratch and integrating them into CI/CD pipelines.

Strong API testing and SQL skills for backend and data validation.

Hands-on performance and scalability testing using JMeter, Gatling, or k6, including workload modelling, SLA definition, and bottleneck analysis.

Strong debugging and root-cause analysis skills using logs, monitoring tools, network tools, and database analysis.

Good understanding of system architecture, distributed systems, cloud platforms, containers, and logging/monitoring.

Experience defining test strategy, entry/exit criteria, and quality metrics (defect leakage, coverage) to drive process improvement.

Domain knowledge in accounting,



ERP, finance, or compliance (e.g., GST) is an advantage.

AI / LLM Testing

Hands-on experience working with AI/ML/LLM-based products or projects.

Strong understanding of LLMs, Generative AI, Prompt Engineering, and AI-based workflows.

Experience defining evaluation strategies for AI systems, including accuracy, consistency, hallucination, robustness,

context handling, and response quality.

Experience validating AI agents, tool/function calling, structured outputs, or RAG-based applications is preferred.

Ability to identify AI-specific edge cases and define appropriate test data, benchmarks, and quality metrics.

Exposure to LLM evaluation, model comparison, and AI-assisted testing is an advantage.

Your Impact at Tally

Quality Ownership: Own QA activities across the complete project lifecycle, from requirements and design to release and production validation.

Test Strategy & Planning: Define test strategy, scope, test coverage, automation approach, environments, test data, and release criteria.

Testing Execution: Drive functional, API, integration, regression, performance, and NFR testing based on project requirements.

Automation & Engineering Excellence: Build and evolve automation frameworks and tooling, and set coding and testing standards for the team.

Risk Management: Proactively identify technical, functional, integration, and release risks, define mitigation plans,

and communicate them early.

Release Readiness: Take ownership of release readiness and provide data-driven quality recommendations.

Production Support: Analyse production issues, drive root-cause analysis, and implement preventive quality improvements.

Mentorship: Guide and mentor QA engineers and raise the technical bar across teams.

Note: Only shortlisted candidates will be contacted for further steps in the hiring process.

📌 Staff Test Engineer - AI (Bengaluru)
🏢 Tally Solutions
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: staff test engineer - ai (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: staff test engineer - ai (bengaluru) / bengaluru