Sully.ai is hiring a QA Automation Engineer on a contract basis. In this role, you will be instrumental in automating our testing process, ensuring product quality as we scale. You'll join a team building category-defining partnerships that enable doctors to focus on saving lives.
What You'll Do
- Translate existing manual and Excel-based test cases into automated Playwright and API test scripts.
- Maintain test frameworks and keep automation stable as the product codebase evolves.
- Integrate automated tests into GitHub Actions CI/CD pipelines with comprehensive reporting and alerts.
- Investigate test failures, diagnose issues, fix flaky tests, and improve test resilience.
- Build dashboards to visualize test coverage, pass/fail trends, and defect patterns for the broader team.
- Collaborate with product, design, and engineering teams to align test coverage with release priorities.
- Scale and optimize test suites for performance and reliability.
What We're Looking For
- Playwright expertise for UI and end-to-end automation.
- Experience with API test automation using tools like Postman/Newman, REST Assured, supertest, or pytest.
- Ability to read, interpret, and convert Excel-based test cases into structured automated tests.
- Hands-on experience with GitHub Actions for running tests in CI/CD, including parallelization and artifact management.
- Proven skill in building dashboards and reporting with tools like Allure, ReportPortal, Grafana, or Power BI.
- Strong break/fix skills to investigate, diagnose, and stabilize failing or flaky tests.
- Comfort and experience with scaling large, complex test suites.
Technical Stack
- UI Automation: Playwright
- API Automation: Postman/Newman, REST Assured, supertest, pytest
- CI/CD & Infrastructure: GitHub Actions
- Reporting & Visualization: Allure, ReportPortal, Grafana, Power BI
Team & Environment
You will collaborate closely with product, design, and engineering teams to ensure quality is integrated throughout the development lifecycle.
Benefits & Compensation
- Competitive salary.
- Equity stake.
- Remote-first culture.
Work Mode
This is a global, remote-first position. Work with a talented, mission-driven team from your location.
Sully.ai is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age.

