About the Role
The role involves analyzing AI-generated text in Chinese Mandarin to ensure accuracy, fluency, and cultural appropriateness while contributing to benchmark development and model evaluation.
Responsibilities
- Evaluate AI-generated Chinese Mandarin text for linguistic quality
- Identify errors in grammar, syntax, and word choice
- Assess fluency and naturalness of machine-translated content
- Ensure translations reflect cultural context and idiomatic expressions
- Rate model outputs based on predefined quality criteria
- Provide detailed feedback to improve language model performance
- Collaborate with engineering teams to refine evaluation methodologies
- Support the development of benchmark datasets for Chinese Mandarin
- Maintain consistency in scoring across evaluation tasks
- Report issues and patterns observed in model outputs
- Stay updated on linguistic trends and language usage in Mandarin-speaking regions
- Follow documentation guidelines for annotation and feedback
- Handle sensitive or nuanced content with cultural awareness
- Work on diverse text types including technical, conversational, and formal content
- Meet quality and productivity targets consistently
Nice to Have
- Prior experience in natural language processing projects
- Exposure to AI benchmarking or model evaluation
- Knowledge of Chinese dialects or regional variations
- Experience working remotely in a global team
- Familiarity with quality assessment frameworks for translation
Compensation
Competitive salary and benefits package
Work Arrangement
Remote
Team
Part of a global team focused on advancing AI language technologies
Language Requirements
- Must be a native speaker of Chinese Mandarin with formal education in the language
- Ability to read and write fluently in simplified Chinese characters
Technical Environment
- Work performed entirely online using secure, browser-based tools
- No specialized software installation required
Not specified
