Bat Around™ is hiring a Senior Software Engineer with deep expertise in R to join our data training efforts. This role focuses on reviewing evaluations completed by data annotators who assess AI-generated R code responses, ensuring strict adherence to quality guidelines for instruction-following, factual correctness, and code functionality.
What You'll Do
- Review and audit annotator evaluations of AI-generated R code.
- Assess if the R code follows prompt instructions, is functionally correct, and secure.
- Validate code snippets using a proof-of-work methodology.
- Identify inaccuracies in annotator ratings or explanations.
- Provide constructive feedback to maintain high annotation standards.
- Work within Project Atlas guidelines for evaluation integrity and consistency.
What We're Looking For
- 5–7+ years of experience in R development, QA, or code review.
- Strong knowledge of R syntax, debugging, edge cases, and testing.
- Comfortable using code execution environments and testing tools.
- Excellent written communication and documentation skills.
- Experience working with structured QA or annotation workflows.
- English proficiency at B2, C1, C2, or Native level.
Nice to Have
- Experience in AI training, LLM evaluation, or model alignment.
- Familiarity with annotation platforms.
- Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.
Technical Stack
- R
Work Mode
This is a global position.
