Responsibilities
- Ensure high-quality standards for AI and large language model applications
- Develop and implement comprehensive testing approaches for consumer-facing LLM products, covering functionality, data integrity, and model behavior
- Evaluate the accuracy, uniformity, reliability, and safety of outputs generated by language models
- Conduct regression testing and assess risks associated with updates to models, prompt engineering, or data modifications
- Build and maintain automation frameworks and testing infrastructure
- Create and optimize automated testing solutions and quality assurance tools to increase efficiency and test coverage
- Leverage artificial intelligence methods, including large language models, to improve test planning, fault detection, and test case creation
Benefits
- Attractive compensation package and comprehensive benefits
- Remote work setup, subject to team-specific operational requirements
Compensation
Competitive salary and company benefits
Work Arrangement
Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)