The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.
At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.
Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems.
Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk.
Content Review & Evaluation Specialist
About the Role
HumanSignal is seeking highly qualified education professionals with exceptional English language and writing skills to contribute to AI development projects. This role involves evaluating, annotating, and validating educational content across various subjects to improve AI model performance in teaching, tutoring, and educational content generation.
Compensation
Up to $40 USD/hour based on qualifications and project complexity
Required Qualifications
Education
Master's degree required in education or related field
PhD strongly preferred in:
Education
Curriculum & Instruction
Educational Psychology
English/English Literature
Linguistics
TESOL/Applied Linguistics
Or closely related educational disciplines
Degree Field Requirements
Candidates must hold degrees directly in education, English, or teaching-related fields. Acceptable programs include:
Education (General, Elementary, Secondary)
Curriculum & Instruction
Educational Leadership
English/English Literature
Linguistics/Applied Linguistics
TESOL/ESL Education
Reading/Literacy Education
Educational Psychology
Language Requirements
Native or near-native English proficiency required
Exceptional written and verbal communication skills
Strong command of English grammar, syntax, and style
Ability to identify and correct errors in writing across various contexts
Responsibilities
Review and evaluate educational content for accuracy, clarity, and pedagogical effectiveness
Assess AI-generated explanations, lesson plans, and instructional materials
Annotate teaching strategies and learning approaches
Validate content across multiple subject areas and grade levels
Identify errors in grammar, spelling, punctuation, and style
Provide detailed feedback on instructional quality and student engagement
Evaluate content for age-appropriateness and educational alignment
Review explanations for clarity and accessibility to diverse learners
Qualifications
Deep understanding of pedagogical principles and instructional design
Excellent writing and editing skills
Strong analytical and critical thinking abilities
Expertise in English grammar, composition, and rhetoric
Experience developing or evaluating educational materials
Familiarity with educational standards (Common Core, state standards, etc.)
Understanding of differentiated instruction and diverse learning needs
Ability to work independently and meet deadlines
Work Details
Flexible, project-based work - work on your own schedule
Remote position - work from anywhere
Variable hours based on project availability and your capacity
Ongoing training and calibration provided
Quality-focused environment with performance feedback
Ideal Candidate Profile
Current or former educators, curriculum developers, or educational researchers
Strong background in classroom instruction or educational content creation
Experience across multiple grade levels or subject areas
Published work or demonstrated excellence in educational writing
Passion for improving AI capabilities in educational contexts
How to Apply
Interested candidates should be prepared to:
Submit CV/resume highlighting educational qualifications
Provide proof of advanced degree(s)
Complete a writing and content evaluation assessment
Participate in a qualification review
HumanSignal is a leading provider of AI data annotation and labeling services, powering the development of next-generation AI systems. We work with top technology companies and research institutions to create high-quality training data.
HumanSignal is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.