Welocalize is hiring an Entertainment Media Content Reviewer to conduct quality audits of contributor evaluations for AI-generated entertainment media content. This remote role focuses on ensuring accuracy, consistency, and alignment with project-specific guidelines to improve contributor performance and model outputs.

What You'll Do

Review contributor evaluations of model-generated responses to ensure adherence to project-specific guidelines and rubric dimensions.
Verify that contributors consistently apply all instructions, constraints, and evaluation criteria when assessing model responses.
Confirm that contributors accurately identify factual errors, hallucinations, or missing information in model responses.
Ensure contributor-selected options align appropriately with rubric dimensions and are justified by evidence.
Review open-text comments from contributors, ensuring they identify areas of opportunity or limitations.
Provide detailed feedback on contributor performance, highlighting areas for improvement.

What We're Looking For

Proven expertise in film and media studies, entertainment journalism, film criticism, media commentary, content analysis focused on movies/TV/streaming, entertainment blogging/reviewing, or pop culture commentary.
Strong familiarity with narrative structures, character arcs, and continuity across cinematic universes and episodic storytelling.
Strong familiarity with contextual and cultural references specific to entertainment media.
Proven experience in AI data annotation, content quality review, search quality rating, or similar roles.
Proven experience evaluating content using structured grading criteria and providing constructive feedback.
Proven experience performing in-depth fact-checking and identifying factual inaccuracies.
Meticulous attention to detail and ability to identify nuanced issues in evaluations.
Ability to work independently and manage workflows effectively in a remote environment.
Familiarity with data annotation platforms and model evaluation tools.
Current residence in one of the following U.S. states: Alabama, Florida, Georgia, Indiana, Kansas, Kentucky, Missouri, Montana, New Hampshire, North Carolina, Ohio, Oklahoma, Pennsylvania, South Carolina, Tennessee.

Nice to Have

Relevant degrees such as a Bachelor’s in Film and Media Studies, Journalism, or related fields.
Prior experience conducting quality audits, content review, or evaluation in an entertainment-related capacity.
In-depth understanding of current trends in pop culture and the entertainment industry.
Ability to interpret prompts referencing specific storylines, characters, franchises, and broader entertainment contexts.
Active use of major streaming platforms and strong familiarity with their catalog of films, television series, and original content.