Responsibilities
- Architect high-throughput solutions that power our most critical operations, ensuring scalability and efficiency.
- Expand and enhance our self-service platform, collaborating with cross-functional teams to fuel our AI, ML, and analytics goals.
- Tackle complex distributed data challenges, streamline system integrations, and uphold high standards of quality and governance.
- Champion cutting-edge technologies, keeping our platform at the forefront of industry advancements and enabling strategic outcomes.
- Unify data from diverse systems, paving the way for experimentation and innovation while empowering teams with intuitive tools and frameworks.
Requirements
- Track record of debugging issues across layers—from application logic to infrastructure bottlenecks—and understand the tradeoffs in system design, not just the settings in a managed UI.
- You don’t just know how to run jobs in tools, you understand how they operate under the hood and how connected storage impacts performance like:
- How simple storage API semantics (e.g. consistency, eventual visibility, multi-part uploads) affect job execution
- The impact of network I/O and data locality on performance and cost
- The way resource scheduling and JVM tuning influence distributed job behavior
- Proven experience as a Software Engineer with a focus on high throughput scalable systems.
- In-depth knowledge of high throughput processing technologies such as Spark, Flink, and/or Kafka.
- Proficiency in Java and strong understanding of object-oriented design, data structures, algorithms, and optimization.
- You have development experience working with data warehouse tools like Snowflake, Clickhouse, Trino, etc
- You’ve experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi
- You are knowledgeable about data modeling, data access, and data replication techniques, such as CDC.
- You have a proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform
- You are excited by new technologies but are conscious of choosing them for the right reasons
Benefits
- competitive perks and benefits
- health & wellness
- equity
Work Arrangement
Remote (Worldwide) — New York City, San Francisco, London, Sydney
Additional Information
- The US base salary range for this full-time position is $178,400 - $205,500 annually + equity + benefits
- For US based applicants
