ShipHero is looking for a Data Platform Engineer to join our Platform Team. In this role, you will be responsible for operating, improving, and extending our data infrastructure to ensure reliability and performance. You'll work closely with engineering teams to enhance data services that help our customers grow their businesses.

What You'll Do

Operate, improve, and extend ShipHero’s data infrastructure.
Support engineering teams in enhancing the performance of reports, searches, and other data services.
Be part of the Platform Team to address performance and reliability challenges in our data systems.
Optimize both relational and non-relational databases for performance and scalability.
Automate infrastructure management using infrastructure-as-code for consistency, scalability, and repeatability.
Participate in a rotative 24x7 on-call rotation.

What We're Looking For

Solid experience operating and improving the reliability of data storage and processing systems—including relational databases, data warehouses, data lakes, and distributed processing systems.
Experience with operational optimization such as indexing, query tuning, and monitoring.
Familiarity with stream processing.
Hands-on experience setting up and managing data processing infrastructure in AWS or GCP.
Comfortable using infrastructure-as-code tools such as Terraform or Ansible.
Experience improving data infrastructure and pipelines using Python, Airflow (or similar), Redshift, and dbt to support scalable data initiatives.

Nice to Have

Experience with the AWS data ecosystem, including services like Amazon Aurora MySQL, DocumentDB/MongoDB, OpenSearch/ElasticSearch, Redshift, Glue/Spark, MSK/Kafka, Kinesis, Debezium, S3/Apache Hudi, and MWAA/Airflow.

Technical Stack

Languages & Frameworks: Python, dbt
Orchestration & Processing: Airflow, Glue/Spark, Kafka, Kinesis, Debezium
Datastores: Redshift, Amazon Aurora MySQL, DocumentDB/MongoDB, OpenSearch/ElasticSearch, S3/Apache Hudi
Infrastructure & Cloud: AWS, GCP, Terraform, Ansible