Mentis AI is recruiting Diabetic Specialist Nurses to evaluate and enhance the performance of our diabetes-specific AI chatbot. Your clinical expertise will be central to assessing AI-generated health guidance and establishing definitive quality benchmarks.
What You'll Do
- Review 20–25 de-identified chatbot transcripts, each 500–700 words long, based on simulated patient interactions.
- Assess the clinical appropriateness, quality, and safety of the chatbot's responses.
- Score each transcript across multiple dimensions, including Factuality, Safety Compliance, Bias, Completeness, and Tone, using a standardized Likert-scale form.
- Your evaluations will form the gold-standard benchmark for the chatbot's performance, directly shaping future model improvements.
What We're Looking For
- A minimum of 1 year of direct experience managing diabetic patients.
- Familiarity with evidence-based diabetes care protocols, patient education, and clinical best practices for diabetes management.
- Strong clinical judgement and comfort evaluating clinical content for accuracy, safety, and appropriateness.
- Ability to assess AI-generated health guidance specifically within a diabetes context.
- Professional working proficiency in English for written deliverables.
- Right to work in your country of residence.
Benefits & Compensation
- Gain hands-on experience in AI evaluation, data quality, and health informatics, with training provided on scoring methodologies.
Work Mode
This is a remote project role based in the UK.
