Welocalize is hiring an Entertainment Media Content Reviewer to conduct quality audits of contributor evaluations for AI-generated entertainment media content. This remote role focuses on ensuring accuracy, consistency, and alignment with project-specific guidelines to improve contributor performance and model outputs.
What You'll Do
- Review contributor evaluations of model-generated responses to ensure adherence to project-specific guidelines and rubric dimensions.
- Verify that contributors consistently apply all instructions, constraints, and evaluation criteria when assessing model responses.
- Confirm that contributors accurately identify factual errors, hallucinations, or missing information in model responses.
- Ensure contributor-selected options align appropriately with rubric dimensions and are justified by evidence.
- Review open-text comments from contributors, ensuring they identify areas of opportunity or limitations.
- Provide detailed feedback on contributor performance, highlighting areas for improvement.
What We're Looking For
- Proven expertise in film and media studies, entertainment journalism, film criticism, media commentary, content analysis focused on movies/TV/streaming, entertainment blogging/reviewing, or pop culture commentary.
- Strong familiarity with narrative structures, character arcs, and continuity across cinematic universes and episodic storytelling.
- Strong familiarity with contextual and cultural references specific to entertainment media.
- Proven experience in AI data annotation, content quality review, search quality rating, or similar roles.
- Proven experience evaluating content using structured grading criteria and providing constructive feedback.
- Proven experience performing in-depth fact-checking and identifying factual inaccuracies.
- Meticulous attention to detail and ability to identify nuanced issues in evaluations.
- Ability to work independently and manage workflows effectively in a remote environment.
- Familiarity with data annotation platforms and model evaluation tools.
- Current residence in one of the following U.S. states: Alabama, Florida, Georgia, Indiana, Kansas, Kentucky, Missouri, Montana, New Hampshire, North Carolina, Ohio, Oklahoma, Pennsylvania, South Carolina, Tennessee.
Nice to Have
- Relevant degrees such as a Bachelor’s in Film and Media Studies, Journalism, or related fields.
- Prior experience conducting quality audits, content review, or evaluation in an entertainment-related capacity.
- In-depth understanding of current trends in pop culture and the entertainment industry.
- Ability to interpret prompts referencing specific storylines, characters, franchises, and broader entertainment contexts.
- Active use of major streaming platforms and strong familiarity with their catalog of films, television series, and original content.
Benefits & Compensation
- Compensation: $22 USD /hour
Work Mode
This is a remote position for candidates located in the United States.
