Responsibilities
- Implement real-time data pipelines with MQTT and Redpanda for stream processing.
- Implement offline data pipelines using Dagster for batch processing.
- Parse and process binary message formats from various data sources.
- Build data warehouses using Postgres, Apache Iceberg, Parquet, and S3.
- Design data models that allow for high-performance queries.
- Validate and normalize data sources.
- Improve local development and CI/CD using modern tooling and GitHub Actions.
Requirements
- Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.)
- Proficiency in Python and Rust for data engineering workflows.
- Experience with binary message parsing.
- Experience with row-based & columnar-based data formats.
- Experience with OLTP & OLAP databases.
- Knowledge of distributed systems, streaming architectures, and batch processing patterns.
- Hands-on experience with a batch orchestrator such as Dagster/Airflow.
- Hands-on experience with a streaming platform such as Redpanda/Kafka.
- Hands-on experience with binary message formats such as Protobuf.
Nice to Have
- Experience with IoT devices and sensors.
- Digital signal processing experience.
- Geospatial analysis and GIS experience.
- Familiar with working in monorepos.
Benefits
- Unlimited PTO
- Dedicated Sick Time
- Comprehensive Health & Benefits – Medical, dental, and vision coverage to keep you and your family protected.
- 11 Paid Holidays
- Professional Development
- Collaborative Environment
- Mission-Driven Work
- Growth Opportunities
- 401(k) with company match.
- Onsite / Remote / Flexible work arrangements or hybrid options (position dependent).
- Relocation assistance (position dependent).
- Referral bonuses.
- Performance bonuses.
- Life insurance and disability coverage.
- Technology home office setup stipend.
- Professional certification reimbursement (position dependent).
Additional Information
- You don’t need permission to sweat the details here.
- We’re building products that make the world safer. But we don’t let that get to our heads.
