Responsibilities
- Design, build, and maintain reliable data pipelines to ingest and process data from external systems
- Implement integrations using Scala, ensuring scalability and resilience
- Handle both full data loads and incremental updates efficiently
- Collaborate with engineering and product teams to align on integration and data needs
- Develop and maintain a unified internal data model
- Ensure data quality, detect and resolve incorrect or incomplete data
- Utilize AI-assisted tools to improve data quality and operational efficiency
- Monitor and optimize data pipelines for production readiness
Requirements
- At least 5 years of experience as a Data Engineer or Backend/Data Engineer
- Strong production experience with Scala
- Proven experience integrating external systems via REST APIs (pagination, rate limiting, token-based authentication)
- Strong data modelling skills with structured, relational data
- Solid SQL knowledge
- Experience with GCP Dataflow
- Experience operating data pipelines in production environments
- Strong communication skills and ability to collaborate across teams
- At least an Upper Intermediate level of English
Nice to Have
- Experience with event-driven architectures or messaging systems
- Designing canonical schemas across multiple data sources
- Experience with LLM (Large Language Models)
