Pathway is hiring a Machine Learning Researcher / Engineer (Foundational Models)

Responsibilities

• perform (distributed) model training
• help improve/adapt model architectures based on experiment results
• design new tasks and experiments
• optionally: oversee activities of team members involved in data preparation

Requirements

• A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply)
• Interested in improving foundational architectures and creating new benchmarks
• Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow)
• Have a good understanding of GPU architecture, memory design, and communication
• Have a good understanding of graph algorithms
• Have some familiarity with model monitoring, git, build systems, and CI/CD
• Respectful of others
• Fluent in English

Nice to Have

• Knowledge of approaches used in distributed training
• Familiarity with Triton
• Successful track-record in algorithms & data science contests
• Showing a code portfolio

Benefits

• Join an intellectually stimulating work environment
• Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data
• Be part of one of an early-stage AI startup that believes in impactful research and foundational changes
• Employee Stock Option Plan