Together AI is seeking a Senior Backend/Distributed Systems Engineer to build and maintain the core codebase for the Together AI Sandbox service. You will design backend software, improve system efficiency and stability, and work closely with the product team to develop new features and maintain existing code. Our research-driven company is on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models.
What You'll Do
- Design core, backend software components.
- Perform architecture and research work for AI workloads.
- Interface with other teams to incorporate their innovations.
- Analyze and improve efficiency, scalability, and stability of various system resources.
- Conduct design and code reviews.
- Create services, tools and developer documentation.
- Create testing frameworks for robustness and fault-tolerance.
- Participate in an on-call rotation to respond to critical incidents as needed.
What We're Looking For
- 5+ years experience writing high-performance, well-tested, production quality code.
- Bachelor's or Master's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Demonstrated experience in building large scale, fault tolerant, distributed systems like storage, search, and computation.
- Expert level programmer in one or more of Golang, Java, Rust, or C/C++.
- Demonstrated experience with relational (e.g., PostgreSQL) and non-relational (e.g., ClickHouse, Redis) databases.
- Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources.
- Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking and storage, performance and scale.
Nice to Have
- Experience with Kubernetes/Nomad and containers.
- Experience with virtual machines, microVMs, or sandboxing technologies (e.g., gVisor, Firecracker, QEMU).
- Experience with Ceph.
- Experience with Elixir.
Technical Stack
- Languages: Golang, Java, Rust, C/C++, Elixir
- Databases: PostgreSQL, ClickHouse, Redis
- Infrastructure & Tools: Kubernetes, Nomad, gVisor, Firecracker, QEMU, Ceph
Benefits & Compensation
- Competitive compensation determined by location, level and role.
- Startup equity.
- Other competitive benefits.
Work Mode
This is a hybrid position based in Amsterdam, Netherlands.
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
