Ciklum is looking for a Senior Automation QA (JS) Engineer to join our team full time in India.
We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.
About the role:
As a Senior Automation QA (JS) Engineer, become a part of a cross-functional development team engineering experiences of tomorrow.
Responsibilities:
• Design, build, and maintain automated test suites for the platform, Frontend and Backend, including contract tests that protect the agent-developer experience as the SDK evolves
• Build automated tests for long-running Temporal workflows including failure injection (worker kill, provider outage, retry storms) to verify durable-execution guarantees such as zero lost runs and correct compensation/saga behavior
• Automate multi-tenant isolation verification cross-tenant data access,
configuration bleed, and cost-attribution correctness executed per release as a platform acceptance criterion
• Verify agent execution sandboxing and egress controls through negative testing of disallowed tool calls and network destinations
• Design test strategies for LLM-driven behavior: statistical assertions over repeated runs (pass^k consistency), semantic-similarity scoring, confidence-threshold validation, and flakiness quarantine that distinguishes model variance from genuine regression
• Build and continuously extend adversarial test corpora document-borne prompt injection in lease PDFs, tool-call hijack, and data-exfiltration probes aligned to OWASP LLM Top 10 and recognized red-team taxonomies
• Verify Human-in-the-Loop (HITL) escalation behavior confidence thresholds fire correctly and no gated/irreversible action completes without authorization
• Partner with the evaluation function
📌 Senior Automation QA (India)
🏢 Ciklum
📍 India