Apply on company website Paris On-site Full-time

Institute of Foundation Models is hiring a Research Scientist - Speech/Audio Machine Learning

Responsibilities

  • Create new neural network designs for fast, real-time speech-to-speech translation and audio generation, including models based on Diffusion, Flow-matching, and Transformer-driven audio language models.
  • Build and apply specialized loss functions to improve speech qualities such as emotional expression, clarity, and natural sound.
  • Run large-scale model training experiments and conduct ablation analyses to evaluate different architectural choices and audio tokenization methods.
  • Develop comprehensive internal evaluation frameworks using objective measures like Word Error Rate and Mel-Cepstral Distortion, alongside human-rated Mean Opinion Score testing.
Job Details
Location Paris
Work mode On-site
Employment Full-time
Department Research
Category Data & ML
Posted 8 months ago
Application On company website
About company
Institute of Foundation Models logo

The Institute of Foundation Models (IFM) at the Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) is a global center of excellence dedicated to advancing the science, scale, and social value of foundation models.

We are building a future where the most powerful AI systems are not only technically advanced but socially meaningful – open, collaborative, and built to solve real-world problems.

From our headquarters in Abu Dhabi, with research hubs in Silicon Valley and Paris, IFM brings together world-class talent across continents to create foundation models that redefine what AI can achieve.

Our mission is ambitious yet grounded: to produce the world’s leading models across modalities – language, vision, multimodal, and domain-specific systems – while ensuring our work drives measurable, positive impact for society.

All jobs at Institute of Foundation Models Visit website