Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
Prompt models to complete complex data science tasks and review the accuracy of generated responses.
Label, proofread, and improve machine-written and human-written software engineering-related outputs.
Report quality and performance trends related to model/agent behaviour and project assignments.

Exceptional data analysis and visualization skills.
3+ years of relevant industry experience working on real-world data science problems and pipelines.
Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
Strong understanding of SQL syntax writing and workflows; and a deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
Prior experience re-writing, proofreading, and delivering feedback on code.

Familiarity with code agents (OpenCode, Claude Code, Codex) or evaluating agent trajectories is a plus.

Remote (Country) — Canada

Initial Screening - Once you have submitted your application, our Talent Team will review your resume and writing samples.
Virtual Annotation Test - This assignment will test your written and technical skills through various language-based tasks, such as a data science take-home assessment, writing sample, and more.
Video Screen - If selected to move forward, you will have a short video call with a member of our Operations Team!
Offer - Independent Contractor Agreement

As an independent contractor, you maintain control over how you complete your work and may work with multiple clients simultaneously.
We request that you declare any external work relationships with Cohere’s direct competitors and always maintain the IP confidentiality of the Cohere project.
Independent contractors are not eligible for health benefits or other benefits provided to employees.
Compensation for services is provided to contractors by self-invoicing for services provided pursuant to the terms of our agreement with the contractor.
It is important to understand that, as an independent contractor, continuous work is not guaranteed.
The client-contractor relationship is fundamentally project-based, meaning engagements may be temporary, periodic, or intermittent based on our organizational needs and project availability.
As an independent contractor, you should anticipate fluctuations in workflow and, therefore, compensation for services when Cohere does not require as many hours of services in a week.

This is a part-time independent contractor position.
Candidates must be able to commit to 16 hours per week minimum.
Contract rate is 40 CAD/hour.
BYOD (Bring Your Own Device) - laptop required.
Remote work within Canada.
12 month contract.
Performance incentives included.
Independent contractors are not eligible for health benefits or other benefits provided to employees.
Compensation for services is provided to contractors by self-invoicing.
Continuous work is not guaranteed.
Engagements may be temporary, periodic, or intermittent based on organizational needs and project availability.
Fluctuations in workflow and compensation are expected when Cohere does not require as many hours of services in a week.
Role involves working with human-generated and model-generated tasks that may involve exposure to not safe for work (NSFW) text content, including explicit, offensive, or other inappropriate material.

Cohere is hiring a Data Annotation Specialist, Data Science