Runware was looking for a Platform Data Engineer

Runware is constructing a cutting-edge AI media generation ecosystem enabling rapid creation of text, image, video, 3D, and audio content. As our platform expands and integrations increase, we require resilient, dependable, and high-performance data infrastructures. We're seeking a Data Engineer to construct and sustain our data framework — specifically targeting extensive logging and performance pipelines. You will collaborate intimately with our Data Expert and platform team to convert unprocessed system activities into structured, queryable, high-value information. 🎯 Mission Your primary objective is to architect, refine, and maintain Runware's data infrastructure. You will guarantee that logs, metrics, performance data, and events are efficiently captured, processed, stored, and prepared for analysis by engineering, machine learning, and product teams. This role is fundamental to: Supporting system observability & platform stability Enabling comprehensive log & performance analytics Powering internal dashboards and customer reporting Providing clean, structured data to the Data Expert and all stakeholders 🧩 What You Will Do Architecture & Ownership Design, construct, and sustain schemas and data models Optimize table configuration, partitioning, indexing, and compression for high-volume information Ensure rapid, efficient querying for logs, requests, metrics, and performance traces Maintain ingestion pipelines for billions of records Data Engineering & Pipelines Construct robust pipelines for: API logs Model inference logs Error events Usage & integration events GPU & system metrics Implement ETL/ELT workflows to transform raw data into analytics-ready structures Ensure quality, reliability, and real-time accessibility of data sources Performance & Log Analysis Infrastructure Develop tooling to support large-scale log analysis Enable comprehensive investigation into latency, throughput, errors, and bottlenecks Provide raw data foundation for end-to-end inference-time monitoring Assist in debugging production challenges using logs and traces Tooling & Observability Infrastructure Collaborate closely with DevOps, Machine Learning, and backend engineering Integrate pipelines with monitoring tools (Prometheus, Grafana, Datadog, OpenTelemetry) Automate ingestion and cleanup tasks Develop internal libraries or utilities supporting monitoring and debugging workflows Collaboration & Cross-Functional Support Provide clean data interfaces for the Data Expert (dashboards, monitoring, analytics) Support engineering teams by exposing appropriate logs and metrics Contribute to debugging, root cause analysis, and performance optimization initiatives Requirements What We're Looking For Substantial experience as a Data Engineer in production environments Strong comprehension of data pipelines, streaming vs batch processing, and data modeling Experience with analytical databases (ClickHouse preferred, but not mandatory) Comfortable investigating logs, metrics, and platform data to understand system behavior Familiarity with event-based systems, monitoring, and observability concepts Pragmatic approach: prioritizing usefulness, reliability, and performance Comfortable working cross-functionally with backend, infrastructure, and data profiles Startup / scale-up experience is advantageous Nice to Have Experience with high-throughput or real-time systems Exposure to cost monitoring, performance analytics, or platform observability Background in AI, machine learning platforms, or data-intensive products Benefits We're a remote-first collective, gathering in-person twice annually to plan, brainstorm, celebrate achievements, and enjoy face-to-face interactions. We maintain core collaboration hours, but outside those periods, your schedule is flexible. Work during hours that maximize your performance while maintaining a healthy lifestyle. Our release cycles are rapid and intense, followed by genuine downtime. After significant pushes, we anticipate team members to disconnect, recharge, and return reinvigorated for the next challenge. Generous paid time off – vacation, sick days, public holidays Meaningful stock options – participate in the value you create Remote-first setup – work from home anywhere we can employ you Flexible hours – manage your schedule outside core collaboration blocks Family leave – paid maternity, paternity, and caregiver time Company retreats – twice-yearly gatherings in inspiring locations Please note: We cannot offer visa sponsorship in the UK currently. Candidates must possess existing work authorization in the UK.