Poolside was looking for a Member of Engineering (Pre-training and inference software)

ABOUT THE ORGANIZATION In the upcoming decade, Artificial General Intelligence will emerge. Only a select few entities will successfully achieve this milestone. Their capacity to accumulate strategic advantages will determine ultimate success. These pioneering organizations will demonstrate unparalleled velocity, attracting global elite talent. They will lead groundbreaking applied research, advanced engineering, robust infrastructure, and scalable deployment. Continuous model training expansion will be prioritized, with substantial capital acquisition supporting their trajectory. Powerful economic ecosystems will be created, with unwavering commitment to user and customer success. Our mission is to develop an AI ecosystem driving economically significant work and scientific advancement. TEAM COMPOSITION We operate as a distributed team spanning Europe and North America, convening monthly for three-day in-person sessions and biannual extended retreats. Our research and production teams blend research-oriented and engineering-focused professionals, unified by a profound commitment to system quality and comprehensive software development understanding. We recognize exceptional engineering accelerates development iterations, enabling cumulative progress. ROLE OVERVIEW You'll contribute to our pre-training team, developing distributed training and inference infrastructure for Large Language Models. This hands-on position emphasizes software development methodologies, maintenance, and architectural design, with access to extensive GPU resources. Exceptional engineering expertise is mandatory. We anticipate comprehensive knowledge of CI/CD, reliability principles, software architecture, and code quality. Basic understanding of LLM training and inference is essential. We seek rapid learners prepared for challenging learning trajectories. MISSION STATEMENT Develop world-leading foundational models for source code generation. RESPONSIBILITIES - Propose and evaluate training development experience innovations - Maintain and enhance training/inference codebases - Develop high-quality Python, Cython, C/C++ code - Perform systematic refactoring - Improve continuous integration/deployment processes REQUIRED SKILLS - Large Language Model comprehension - Transformer fundamentals - Deep learning principles - Robust engineering background - Programming proficiencies - Linux environments - Advanced algorithmic capabilities - Python (numpy, PyTorch, Jax) - C/C++ expertise - CI/CD implementation - Tool adaptability - Critical analytical thinking RECRUITMENT PROCESS - Initial consultation with Founding Engineer - Technical interview - Team compatibility assessment - Final interview with Founding Engineer COMPREHENSIVE BENEFITS - Full remote work flexibility - 37 annual vacation/holiday days - Health insurance for employee and dependents - Provided technological equipment - Wellness and learning allowances - Frequent team gatherings - Inclusive, people-centered culture