Responsibilities
- Annotating and labeling large volumes of visual data — including images, UI layouts, compositions, graphics, and photography — with high precision
- Evaluating AI-generated outputs for aesthetic quality, composition, accessibility, usability, and brand alignment
- Developing visual scoring rubrics and structured evaluation frameworks to guide model improvement
- Identifying patterns, failure modes, and edge cases to help improve model performance
- Translating nuanced design critique into structured, actionable feedback for ML engineers and research scientists
- Using generative AI tools to prototype workflows, test hypotheses, and creatively explore model behaviors
- Contributing to the development of taxonomies for visual styles, attributes, and design patterns
- Maintaining high standards of data quality and documentation across annotation projects
Requirements
- You have strong design fundamentals — composition, color theory, typography, layout, hierarchy, and storytelling are second nature to you
- You have a portfolio that demonstrates visual excellence across graphic design, product design, UI/UX, illustration, or related domains
- You’re familiar with generative AI tools and understand how training data and annotation influence model behavior
- You can evaluate visual outputs with precision and clearly articulate structured, repeatable feedback
- You’re comfortable working in documentation-heavy, cross-functional environments
- You’re excited by the idea of shaping how AI models “see” and “create”
Nice to Have
- Experience with Figma, Adobe Creative Cloud, or 3D tools
- Prior annotation, data labeling, or ML operations experience
- Basic familiarity with Python, prompt engineering, or dataset tooling
- Knowledge of accessibility guidelines (e.g. WCAG), usability heuristics, or user research
Additional Information
- This is a 6-month engagement working full time hours.
- Interviews are conducted virtually.
- When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process.
