Responsibilities
- Own the QA Strategy: Design, plan and develop the comprehensive Testing and AI Validation Strategy, covering Functional/Unit, E2E, Integration, Regression, and User Acceptance Testing (UAT).
- Address NFR and align against standards (e.g. GDPR, HIPAA, HITRUST, etc.).
- AI Validation Logic: Define validation plans for AI components, specifically determining what constitutes "correct" output, setting success thresholds, and establishing evaluation methods (including handling hallucinations and grounding rules).
- Environment & Data: Create detailed plans for Test Environments (Dev/Test/Prod) and define the Test Data Strategy to ensure sufficient coverage for standard scenarios, edge cases, and ingestion failures.
- Hands-on Testing: Execute functional, regression, exploratory, performance, and load tests.
- Integration Coordination: Coordinate "Joint End-to-End Validation" efforts, collaborating with the client team to manage testing of Salesforce integration.
- Pipeline Integration: Integrate testing activities into the CI/CD pipeline for continuous quality assurance.
- Process Management: Manage Jira test case structures aligned to user stories and acceptance criteria.
- Metrics: Provide regular reporting, tracking key QA metrics such as defect ratios.
Additional Information
- Full time availability required
- Overlap during 14:00-18:00 with USA based client required
