Responsibilities
- Develop, test, and deploy robust web scraping scripts and crawlers using advanced Python tools (Playwright, Selenium, Requests, BeautifulSoup, etc.)
- Architect and maintain asynchronous scraping systems capable of massive, large-scale data extraction
- Implement, monitor, and optimize sophisticated anti-blocking strategies and proxy rotation to ensure high reliability and uptime
- Manage and automate data ingestion pipelines and seamless integrations with external REST APIs
- Debug, monitor, and continuously improve scraper performance, reliability, and data quality
- Partner with other engineers to enhance our core scraping infrastructure, tooling, logging, and monitoring systems
- Assist with DevOps tasks, including Docker, CI/CD, and managing Linux environments
Benefits
- A high degree of freedom and the opportunity to have a meaningful, measurable impact on a growing scale-up business
- A high degree of flexibility – our client is a remote-first company and actively support remote work
- A competitive compensation package and dedicated support for your personal & professional development (ongoing training & coaching)
- A great work atmosphere within a small, talented, and international team
- A modern office located on the campus of Wildau Tech University, easily accessible by public transport (just outside Berlin)
Work Arrangement
Remote (Worldwide)
Team
Team size: small. Structure: international team
Additional Information
- Fluent in English (written and spoken)
