Phonely is hiring an Applied Machine Learning Researcher

Responsibilities

• Investigate and enhance large language model performance in real-time spoken dialogue systems
• Plan and execute fine-tuning trials across datasets, model configurations, and evaluation methodologies
• Create evaluation systems to assess model accuracy, instruction adherence, conversational fluency, consistency, task success, and overall interaction quality
• Examine live conversation logs to identify failure patterns and areas for model enhancement
• Design methods for data selection, annotation, and synthetic data generation
• Evaluate different model designs, training techniques, prompting strategies, and data sources
• Diagnose performance regressions and provide clear explanations for changes in model behavior
• Collaborate with engineering teams to implement research advancements in production safely and efficiently
• Contribute to establishing criteria for model deployment, evaluation checkpoints, and quality standards