Responsibilities
- Evaluate AI outputs related to healthcare, medical, and life sciences content
- Perform structured scoring, comparison, classification, and judgment task
- Assess clinical accuracy, scientific validity, completeness, and potential safety risk
- Identify hallucinations, misleading medical guidance, unsupported claims, or unsafe recommendations
- Apply domain-specific healthcare and life sciences guidelines consistently across tasks
- Validate and refine evaluation rubrics and edge-case handling
- Perform adjudication where raters disagree
- Conduct error analysis and qualitative reviews of model behavior
- Partner with LILT research, product, and customer teams on evaluation design
- Support red-teaming, clinical risk analysis, and model readiness assessments
Requirements
- Deep domain expertise in healthcare, medicine, or life sciences
- Strong judgment and ability to apply criteria consistently
- Comfort working with structured evaluation workflows
- Ability to explain reasoning clearly, especially in safety-critical scenarios
- Reliability, professionalism, and respect for quality standards
Nice to Have
- Healthcare professionals, clinical practitioners, life sciences researchers, or biomedical specialists
- Experience interpreting medical literature, clinical guidelines, scientific research, or health data
- Strong attention to detail and comfort working with structured evaluation criteria
- Senior clinicians, healthcare leaders, medical researchers, or life sciences subject matter experts
- Experience defining standards, reviewing complex edge cases, or advising on clinical or scientific risk
- Ability to clearly explain nuanced medical or scientific reasoning and tradeoffs
Benefits
- Contract-based, flexible participation
- Project-based work with clear expectations and timelines
- Opportunities for recurring work based on performance and demand
- Compensation communicated upfront per project or task type
- Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Work Arrangement
Remote (Worldwide)
Additional Information
- Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
