About the Role
The position is responsible for overseeing program workflows, ensuring data quality, aligning cross-functional teams, and maintaining operational efficiency within human data initiatives.
Responsibilities
- Manage end-to-end operations for human-generated data programs
- Coordinate timelines and deliverables across research and engineering teams
- Develop and refine processes to improve data collection accuracy
- Monitor program performance using defined metrics and benchmarks
- Identify bottlenecks in data pipelines and implement solutions
- Ensure compliance with data privacy and ethical guidelines
- Lead vendor coordination and contractor oversight when applicable
- Maintain documentation for operational procedures and workflows
- Support the scaling of data operations as project demands grow
- Collaborate with technical teams to integrate feedback into model development
- Track budget allocations and resource utilization for data initiatives
- Facilitate communication between data contributors and internal stakeholders
- Implement quality assurance protocols for incoming data
- Adapt program strategies based on evolving research requirements
- Produce regular reports on program status and outcomes
- Contribute to the design of data annotation tasks and instructions
- Ensure consistency in data labeling across different projects
- Manage onboarding and training for data contributors
- Evaluate new tools and platforms to enhance operational efficiency
- Support incident response and risk mitigation related to data operations
Nice to Have
- Master’s degree in data science, social science, or related area
- Experience managing programs in AI or technology research
- Background in behavioral or cognitive science
- Familiarity with human-in-the-loop systems
- Prior work with large-scale data collection efforts
- Experience in a startup or high-growth environment
- Knowledge of natural language processing applications
- Understanding of statistical methods for data validation
- Experience with international teams or multilingual data
- Exposure to AI safety or alignment research
Compensation
Competitive salary and benefits package
Work Arrangement
Hybrid work model with flexibility based on role and team needs
Team
Part of the human data team focused on managing data operations for AI safety and research
Our Approach to Human Data
We prioritize ethical sourcing, contributor well-being, and data transparency in all human data programs. This role ensures alignment with these principles while maintaining operational rigor.
Impact of This Role
The work directly influences the quality and safety of AI models by ensuring reliable, high-integrity human feedback is systematically collected and integrated.
Available for qualified candidates requiring work authorization
