CVS Health is seeking a seasoned Staff Automation Engineer to lead the design, development, and maintenance of robust, scalable test automation frameworks. This role will drive quality across web, API, and microservices using Playwright and BDD practices, while embedding testing deeply into CI/CD pipelines to accelerate reliable, frequent releases.
What You'll Do
- Build and own Playwright-based automation frameworks (TypeScript/JavaScript or Python) for UI, API, and end-to-end scenarios
- Define test strategy around Gherkin, collaborate on feature files, and integrate with tools like Cucumber (or SpecFlow/Behave) to align tests with business outcomes by adapting BDD
- Integrate automated test suites into pipelines (GitHub Actions, Azure DevOps, Jenkins, GitLab CI), enabling fast feedback, parallel execution, flaky test management, and quality gates by embedding CI/CD
- Partner with developers on testability, contract testing (e.g., Pact), mocking, and service virtualization to keep tests fast and reliable
- Establish and maintain coverage for functional, accessibility, cross-browser/device, and basic performance checks; drive test data strategies and environment configuration
- Operationalize instrument tests for observability (dashboards, trends, test analytics), triage failures, and continuously improve stability
- Mentor engineers on automation best practices, code reviews, and BDD collaboration; champion quality across squads
- Collaborate to ensure quality controls support security, privacy, and compliance requirements (e.g., OWASP considerations in test scenarios)
- Keep clear, versioned documentation for frameworks, guidelines, and runbooks
- Support mobile automation using Appium or Detox
- Ensure cross-browser/device coverage via BrowserStack or Sauce Labs
- Implement contract testing with Pact for microservices
- Embed security and accessibility checks using OWASP ZAP and axe-core
- Explore AI-driven testing for self-healing locators and intelligent test generation
What We're Looking For
- At least 7+ years in software test automation with a track record of delivering frameworks and large test suites
- 5+ years of expertise within Playwright or similar modern framework (TypeScript/JavaScript or Python): specifically within parallel runs, fixtures, test isolation, network interception, retries, trace viewer, and cross-browser strategies
- 5+ years of strong BDD experience: Gherkin proficiency; collaboration with Product/BA on acceptance criteria; integrating Cucumber/SpecFlow/Behave in pipelines
- 5+ years of experience being a CI/CD expert with proven hands-on integrating tests into pipelines (GitHub Actions, Azure DevOps, Jenkins, GitLab CI); artifact management; gating strategies; containerized test execution (Docker)
- 5+ years of experience with REST/GraphQL testing via Playwright, Postman/newman, or native libraries; familiarity with contract testing (e.g., Pact) and mocking
- 5+ years of experience leveraging AI for test case generation, self-healing locators, intelligent test selection, or summarizing failures; familiarity with tools or building internal utilities
Nice to Have
- Performance testing: Baseline perf checks using Playwright trace/metrics, k6, or JMeter; integrating perf smoke into CI
- Accessibility: Automated a11y checks (axe-core, Playwright a11y) and WCAG awareness
- Contract & integration testing: Pact, wiremock/service virtualization
- Observability & quality analytics: Dashboards with ELK/EFK, Grafana, or custom reporting; trend analysis of flaky tests and MTTR
- Cloud & containers: Running tests in Docker; Kubernetes test runners; experience with AWS/Azure/GCP for test infrastructure
- Security basics: Familiarity with OWASP testing considerations; integrating SAST/DAST into CI
- Mobile & cross-platform: Playwright for mobile web, Appium for native when relevant
- Code quality: ESLint/Prettier, SonarQube, and coverage tooling (nyc/istanbul, Jest coverage)
- Quality mindset: Strong debugging skills, flaky test mitigation, root-cause analysis, and test data management
- Soft skills: Team player, excellent communication, ability to work cross‑functionally, proactive ownership, and mentoring experience
- Coding fundamentals: Clean, maintainable test code; strong grasp of design patterns (Page Object, Screenplay, fixtures), code reviews, and version control (Git)
Technical Stack
Playwright, TypeScript, JavaScript, Python, Gherkin, Cucumber, SpecFlow, Behave, GitHub Actions, Azure DevOps, Jenkins, GitLab CI, REST, GraphQL, Postman, newman, Pact, Docker, Appium, Detox, BrowserStack, Sauce Labs, OWASP ZAP, axe-core, k6, JMeter, ELK, EFK, Grafana, AWS, Azure, GCP, Kubernetes, ESLint, Prettier, SonarQube, nyc, istanbul, Jest, Git
Team & Environment
Cross-functional team collaborating with Engineering, Product, and DevOps
Benefits & Compensation
- Affordable medical plan options
- 401(k) plan (including matching company contributions)
- Employee stock purchase plan
- No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
- Paid time off
- Flexible work schedules
- Family leave
- Dependent care resources
- Colleague assistance programs
- Tuition assistance
- Retiree medical access
- Bonus, commission or short-term incentive program
- Equity award program
Compensation: Salary range $118,450.00 - $284,280.00. Eligible for an award target in the company’s equity award program and CVS Health bonus, commission or short-term incentive program.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.
