Poolside is hiring a Member of Engineering (Data Platform)

ABOUT THE ORGANIZATION In this era, the advancement of Artificial General Intelligence will define technological leadership. Only a select few entities will emerge as pioneers. These innovators will accelerate progress, attract exceptional talent, and lead groundbreaking research, engineering, infrastructure, and large-scale deployment. They will continuously enhance model capabilities, secure significant capital, create powerful economic frameworks, and prioritize user and customer success. Our organization aims to establish AI as the driving force behind economically valuable work and scientific advancement. TEAM OVERVIEW We are a distributed team spanning Europe and North America, converging monthly for three-day in-person meetings and biannual extended retreats. Our research and production teams blend research-oriented and engineering-focused professionals who are deeply committed to system quality and possess comprehensive software development expertise. We believe superior engineering enables faster development iterations, compounding our collective efforts. ROLE DESCRIPTION Our data infrastructure empowers research teams to construct high-quality, extensive datasets for pre-training and post-training, facilitating comprehensive experiments from data retrieval through evaluation and benchmarking. MISSION Develop a resilient platform supporting high-quality data pipeline creation and enabling rapid, efficient, end-to-end experimentation. You will be crucial in data engineering, ensuring infrastructure scalability, reliability, and optimization for large-scale data processing. RESPONSIBILITIES Team members will: - Support core data pipelines and enhance data infrastructure - Collaborate with open-source big data solutions and internal systems - Improve system performance, scalability, and reliability for extensive data processing REQUIRED SKILLS & EXPERIENCE - Advanced programming skills in Python, Go, C, or C++ - Expertise in distributed systems, data pipelines, processing systems, and query engines - Desirable: Container runtime and Linux system programming experience - Desirable: Kubernetes and Apache Spark familiarity RECRUITMENT PROCESS - Initial consultation with team member - Technical interview(s) with engineering team - Cultural alignment discussion with People team - Final interview with founding engineer BENEFITS - Fully remote work with flexible scheduling - 37 days annual vacation and holidays - Health insurance for employee and dependents - Company-provided equipment - Wellness and learning allowances - Regular team gatherings - Inclusive, people-first culture