Responsibilities
- Create and manage automated test frameworks and scripts in Python or Java for ML inference services and platform modules
- Generate realistic test accounts and datasets to simulate diverse usage scenarios for model evaluation
- Assess model outputs including score distributions, ranking patterns, and quality metrics before deployment
- Conduct functional, integration, regression, and API testing across RESTful services, microservices, and databases
- Perform non-functional testing such as performance and load testing to validate service scalability and latency
- Ensure automated test coverage for all new features and fixes in alignment with CI/CD pipelines
- Collaborate with machine learning and operations teams to integrate testing into development workflows
- Investigate and document test failures, model irregularities, and system defects
- Promote rigorous quality standards in engineering decisions and customer-facing functionality
- Establish scalable and maintainable test automation best practices
- Monitor test execution efficiency and improve performance in testing environments
- Propose novel approaches to solve testing and organizational challenges
Work Arrangement
Remote — San Mateo
