Responsibilities
- Build and maintain automated test coverage for the Workflow Engine using Playwright
- Validate critical product flows end to end, from workflow creation and configuration through execution and debugging
- Test backend services, APIs, webhooks, and asynchronous workflow behavior in addition to UI flows
- Design coverage for complex scenarios including retries, branching logic, partial failures, race conditions, scheduling, and long-running execution
- Partner closely with engineers and product managers to improve testability, clarify acceptance criteria, and catch issues earlier in the development cycle
- Improve the quality of our CI signal by reducing flakiness, increasing reliability, and making failures easier to debug
- Build reusable fixtures, test data setup, helpers, and tooling that make automation easier to write and maintain
- Investigate product issues and test failures deeply to identify root cause and prevent recurring regressions
- Help define the quality strategy for one of the more complex parts of the Paragon platform
Requirements
- Strong hands-on experience with Playwright and end-to-end automation for complex product flows
- Experience testing backend systems, APIs, and asynchronous or event-driven workflows
- Strong debugging skills across browser tests, APIs, logs, and distributed system behavior
- Ability to reason through stateful systems and edge cases like retries, timing issues, duplicate events, partial failures, and long-running jobs
- Experience building and maintaining stable automation in CI/CD environments
- Strong coding skills and comfort working in a modern engineering codebase
- Ability to work closely with engineers and act as a quality owner, not just a test executor
- Clear communication and sound product judgment around risk, coverage, and release quality
Nice to Have
- Experience with TypeScript
- Experience testing workflow, orchestration, or automation products
- Experience testing integrations, webhooks, and third-party APIs
- Experience building reusable Playwright frameworks, fixtures, or internal testing tools
- Experience with observability tools and production debugging
- Experience with performance or reliability testing
