Winona is hiring a Senior QA Engineer to focus on Conversion Rate Optimization (CRO) and web experimentation. In this hands-on role, you will ensure the quality, reliability, and accuracy of web-based experiments that directly impact business growth.
What You'll Do
- Own end-to-end QA for CRO experiments across multiple platforms and devices.
- Validate experiment setups in Optimizely and similar platforms, including targeting rules, traffic allocation, and variant logic.
- Verify analytics and tracking with tools like GA4, Adobe Analytics, Mixpanel, Segment, and Amplitude to ensure accurate data collection.
- Debug front-end issues such as selectors, dataLayer problems, JavaScript, and HTML/CSS that impact experiment performance.
- Execute QA across browsers and devices using tools like BrowserStack.
- Identify risks such as flicker, layout shifts, accessibility issues, or personalization conflicts.
- Proactively identify potential conflicts that could disrupt core user flows or break critical site functionality.
- Document QA findings, edge cases, and validation results with clarity.
- Collaborate cross-functionally with developers, marketers, product managers, and analysts.
- Contribute to QA process improvements, including automation opportunities.
What We're Looking For
- 5+ years of experience in QA.
- At least 3 years focused on CRO testing or web experimentation.
- Hands-on experience with Optimizely or similar A/B testing platforms like VWO or Google Optimize.
- Strong knowledge of validating tracking with GA4, Adobe Analytics, Amplitude, Mixpanel, or Segment.
- Proficiency with browser dev tools for debugging JS, HTML, and CSS.
- Familiarity with tools like BrowserStack and Postman.
- Experience working cross-functionally with developers, product managers, marketers, and analysts.
- Ability to build and implement experiment variants directly in testing tools or in code.
- Understanding of responsive design, accessibility, and performance optimization.
- Ability to debug broken selectors, dataLayer issues, console errors, and personalization conflicts.
- Experience validating custom events, GTM/Optimizely event tracking, and ensuring correct data flow.
- Knowledge of A/B test risks such as sample ratio mismatch (SRM) and traffic allocation errors.
- Strong understanding of asynchronous scripts, multi-variant testing, and testing under real traffic conditions.
- A personal computer with stable internet capable of efficiently running development tools and applications.
- Available to work 3–4 hours during EST to collaborate with the US team.
Technical Stack
- A/B Testing Platforms: Optimizely, VWO, Google Optimize
- Analytics: GA4, Adobe Analytics, Amplitude, Mixpanel, Segment
- Tools: BrowserStack, Postman
- Web Technologies: JavaScript, HTML, CSS
Team & Environment
You will collaborate closely with developers, product managers, marketers, and analysts.
Benefits & Compensation
- Work wherever you choose.
- Unlimited Paid Time off.
- Paid non-working holidays per country of residence.
- Pro-rated 13th-month bonus in select regions.
- Referral bonuses.
- Financial support for online courses.
- Fun and casual work environment.
- Employee engagement activities and virtual gatherings.
Work Mode
This is a global, remote position.
Winona provides equal employment opportunities to all qualified individuals without regard to race, color, religion, sex, gender identity, sexual orientation, pregnancy, age, national origin, physical or mental disability, military or veteran status, genetic information, or any other protected classification.




