What You'll Do
Design and refine the architecture behind a platform that transforms unstructured data for use in large language models. You'll build distributed systems capable of handling vast amounts of data from varied sources and formats, ensuring they scale efficiently and remain resilient under load.
Take ownership of Kubernetes infrastructure—designing clusters, tuning performance, and ensuring reliability across environments. Lead Python-based service development with a focus on clean, maintainable, and high-performance code. Optimize Postgres usage by refining schema design, indexing strategies, and query efficiency to support complex retrieval workflows.
Guide senior engineers through technical design and code reviews, raising the overall standard of engineering across teams. Collaborate closely with infrastructure and product groups to turn experimental prototypes into robust, production-ready systems. Evaluate new tools and open-source technologies in the LLM and orchestration space, making informed decisions about adoption and integration.
Requirements
- 10+ years of software engineering experience, with deep involvement in distributed systems, data infrastructure, or scalable backend systems
- Strong command of Python, including experience building frameworks and performance-sensitive services from the ground up
- Proven expertise in Kubernetes—able to design, troubleshoot, and secure large-scale deployments
- Advanced knowledge of Postgres, including query optimization, partitioning, and indexing for high-throughput scenarios
- Ability to lead architectural direction and influence system design across teams
- Background in AI/ML or data-intensive systems, particularly those involving embeddings, retrieval pipelines, or hybrid processing workloads
- Comfort operating in fast-paced, evolving environments where technical judgment outweighs rigid process
Preferred Qualifications
- Production experience with LLM or RAG systems
- Familiarity with open-source orchestration tools, vector databases, or hybrid cloud setups
- Contributions to notable open-source projects in Python, Kubernetes, or distributed systems
Benefits
- Medical, dental, and vision coverage from day one
- Unlimited paid time off
- Flexible parental leave policy
- 401(k) options with company support
- Company-funded offsites and team gatherings
- High-quality tools and equipment tailored to your workflow
- Competitive referral bonuses
- Best-in-class swag
