Company Overview : Docusign brings agreements to life. Over 1.5 million customers and more than a billion people in over 180 countries use Docusign solutions to accelerate the process of doing business and simplify people’s lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now, these were disconnected from business systems of record, costing businesses time, money, and opportunity. Using Docusign’s Intelligent Agreement Management platform, companies can create, commit, and manage agreements with solutions created by the #1 company in e-signature and contract lifecycle management (CLM).

What You'll Do : This is an individual contributor role reporting to the Senior Manager, SDET. - Responsibility - Independently own test coverage across multiple product components including UI, API, backend, data validation, integration, and regression testing

- Develop and execute comprehensive test plans, test cases, and test scripts for end-to-end business flows aligned to acceptance criteria

- Drive shift-left quality practices by partnering with developers and platform architects early in the SDLC to identify testability gaps and integrate quality into design

- Own test coverage metrics, dashboarding, and quality reporting to leadership

- Perform exploratory, functional, SIT, regression, and UAT testing for critical releases; support production smoke testing and hypercare post go-live

- Identify requirement gaps, provide robust edge cases and error-handling scenarios beyond documented functionality, and contribute to continuous quality improvemen- Design and execute prompt test suites to validate LLM output accuracy, consistency, tone, and alignment with expected outcomes across diverse input scenarios





- Conduct hallucination detection and post-processing fact-checking for LLM-generated content; validate that AI outputs are grounded in retrieved context

- Validate training/validation datasets for missing values, data leakage, class imbalance, duplicates, and biased sampling

- Execute model quality testing using metrics such as accuracy, precision/recall, F1, ROC-AUC, and regression error (MAE/RMSE) as applicable to the model type

- Verify model behavior under noisy, incomplete, adversarial, or out-of-distribution inputs

- Validate prompt-injection resistance, jailbreak detection, harmful/toxic content filtering, and secure handling of sensitive data and PII

- Implement AI evaluator frameworks using tools such as Arize AX for offline evaluation (datasets, experiments) and online testing (tracing, drift monitoring, confidence scoring)

- Track hallucination rates, latency variability, token cost, and model confidence thresholds in collaboration with MLOps teams- Leverage Docusign's internal Quality Agent (CrewAI-powered, Azure OpenAI-backed) to accelerate test case generation from Jira user stories, reducing manual effort and improving STLC throughput

- Test retrieval relevance, semantic search accuracy (Azure AI Search), context window utilization, and end-to-end response quality for RAG-based AI features

- Build and maintain robust, reusable automation suites for functional, regression, integration, performance, and data validation testing





- Automate end-to-end business flows using UiPath or equivalent low-code/RPA automation platforms; build solutions that reduce manual effort for repetitive processes

- Integrate automated tests into CI/CD pipelines (GitLab CI or equivalent) to support rapid, reliable releases and continuous quality gates

- Develop and maintain data validation automation scripts; perform source-to-target validation, data quality checks (accuracy, completeness, consistency, timeliness), and business rule validations on platforms such as Snowflake- Conduct code reviews with a focus on test quality, reliability, and maintainability; contribute to continuous improvement of the automation system

- Partner closely with product managers, business analysts, developers, and platform architects to align testing strategy to business outcomes and delivery goals

- Participate in requirements workshops, sprint ceremonies, change management processes, and go-live support activities

- Proactively communicate quality risks, test coverage gaps, defect trends, and improvement recommendations to team and leadership

- Mentor junior SDET and QA team members in automation best practices, AI testing tools, and low-code platform usage Job Designation :

- Hybrid**: Employee divides their time between in-office and work from home. Access to an office location is required. (Frequency: Minimum 2 days per week; may vary by team but will be weekly in-office expectation)

- Positions at Docusign are assigned a job designation of either In Office, Hybrid or Remote and are specific to the role/job. Preferred job designations are not guaranteed when changing positions within Docusign. Docusign reserves the right to change a position's job designati

📌 Sdet (Bengaluru)
🏢 Docusign
📍 Bengaluru