Role Overview
We’re looking for qualified Computer Science professionals to assess the accuracy of AI-generated graphical abstracts based on scientific research papers. In this fully remote, flexible role, you’ll use your technical expertise to evaluate how well visual summaries reflect the content and meaning of the original source material.
What You’ll Do
- Compare LLM-produced graphical abstracts with their corresponding computer science research papers
- Identify technical inaccuracies, misrepresentations, or omissions in visual summaries
- Apply deep subject-matter knowledge to verify correct interpretation of algorithms, systems, models, and methodologies
- Ensure that both textual and visual elements align with the scientific claims and contributions of the original work
What We’re Looking For
- Advanced degree (Master’s or PhD) in Computer Science or a closely related technical field
- Strong grasp of core and emerging computer science concepts and research practices
- Proven ability to analyze technical content critically and assess factual correctness
- Experience with fact-checking, peer review, or academic evaluation is highly valued
- Familiarity with AI model outputs, training data, or evaluation workflows is a plus
Compensation & Work Environment
- Competitive pay for each evaluation task
- Work on an ad hoc basis—fit reviews into your schedule as availability allows
- 100% remote from anywhere in the world
Our Mission
We believe high-quality AI development depends on diverse, ethically sourced human insight. By contributing your expertise, you’ll help build more accurate, reliable, and aligned AI systems that reflect real-world knowledge and reasoning.
