Apply on company website Warsaw, Poland Hybrid Full-time

QED.ai is hiring a Data Platform Engineer

Requirements

  • experience designing and maintaining data pipelines using ETL and/or ELT approaches, with the ability to reason about trade-offs rather than defaulting to a single pattern
  • understanding of data pipeline reliability concepts, including idempotency, backfills, and handling late or corrected data
  • ability to structure data systems into clear layers (e.g. raw, cleaned, curated) and reason about their different purposes and guarantees
  • experience deciding between batch, micro-batch, and streaming approaches based on latency, correctness, and operational complexity
  • strong background in software engineering, version control, writing readable code and tests, robust design, and basic data structures and algorithms
  • ability to conceive logical software architectures and express yourself clearly, both verbally and in writing
  • willingness to tackle a wide array of problems and technologies
  • willingness to participate in regular design sessions, code reviews, and working in teams
  • development primarily on UNIX-based or OSX-Darwin platforms
  • working proficiency (≥C1) in speaking, reading, and typing English (≥45 words per minute)
  • willingness and interest in working with people from other cultures
  • emotional resilience and social intelligence
  • you have to care about the work that you do
  • you have to be optimistic at least sometimes, although pessimism tends to be useful

Nice to Have

  • understanding of analytical data modeling concepts, including how to transform raw data into analytics-ready datasets and define clear data semantics for downstream consumers
  • experience with Python, Django, DBT, Dagster, Luigi or Clickhouse
  • experience with containerization (Docker), Terraform, Kubernetes or Nix
  • knowledge and experience with data warehousing, online analytical processing, metadata management, dimensional modeling, and relational database theory
  • experience with programming and/or math competitions
  • product-oriented mindset
  • willingness to go on an adventure
  • domain knowledge and/or interest in the sustainable development goals, particularly in public health, agriculture, and assisting developing countries

Benefits

  • unusual, socially conscious projects
  • significant ownership
  • a mix of product, internal platform, and client integration work
  • ability and encouragement to explore technologies other than your main expertise
  • optional travel to learn more about problems we're trying to solve

Work Arrangement

Hybrid — Warsaw, Poland

Additional Information

  • Requires a full-time commitment physically based in Warsaw, Poland, with a hybrid of remote and in-person work throughout the week.
  • We expect at least 2-3 days per week in the office.
  • The working hours are flexible, for example you do not need approval to take out a small chunk in the middle of the day to handle some personal business.
Required Skills
PythonDjangoClickHouseData Warehousing
Test your skills for this role

Take a short quiz and show this employer what you can do.

Job Details
Location Warsaw, Poland
Work mode Hybrid
Employment Full-time
Department Engineering
Category Data & ML
Posted 8 months ago
Application On company website
or drop your CV first
About company
QED.ai logo

Quantitative Engineering Design (QED.ai) builds data systems and AI for human health and agriculture, the two fields we believe are most relevant to the security of humankind. We are a fully mission-driven technology company. We have regional expertise in development and humanitarian projects in Sub-Saharan Africa, South Asia, and Latin America. Our work aligns with the UN Sustainable Development Goals 2, 3, and 15.

We empower local organizations in developing countries by using technology to build their capacity. We shape and adapt software and hardware to address their needs on the ground, to improve collection and analysis of data to assist in making informed policy decisions. We focus on adjusting and deploying technologies in highly-demanding environments.

Our team works with local experts, gathering insights and developing practical solutions together. Simultaneously, we provide training to develop local capacity and ensure project sustainability. We have boots-on-the-ground data collection and project support in Sub-Saharan Africa. We have incorporations in USA, EU, Kenya, and Asia.

Since QED’s inception in 2008, we have provided mission-critical support to many health and agriculture projects, in 13 countries. We built data processing pipelines for the surveillance of malaria, child mortality, crop disease, and soil health. We provide the analytical tools needed by our partners to execute targeted interventions. Our projects are implemented in collaboration with organizations such as the Centers for Disease Control and Prevention (CDC), the Gates Foundation (BMGF), the International Maize and Wheat Improvement Center (CIMMYT), and the United States Agency for International Development (USAID).

All jobs at QED.ai Visit website