Responsibilities
- Develop and sustain large-scale Python-based scraping infrastructure targeting well-protected sites like Google
- Create scrapers capable of handling complex, dynamic pages powered by JavaScript using browser automation and mixed techniques
- Respond proactively to shifts in website layouts, request patterns, and anti-bot measures
- Build reliable data extraction pipelines emphasizing correctness, uniformity, and monitoring capabilities
- Design and apply strategies involving proxies, device fingerprinting, and intelligent request routing to enhance system resilience and output
- Track scraping performance, identify issues early, and resolve live system problems swiftly
- Improve efficiency, reduce operational costs, and minimize latency across the scraping ecosystem
- Collaborate with data engineering, data science, and product teams to ensure data quality and usability
- Maintain clear documentation of scraping logic and operational procedures for long-term sustainability
Benefits
- Engineering-driven startup environment
- Highly rated workplace culture with 93% employee approval and 27 eNPS
- Recipient of the 2025 US Search Award for Best AI Search Software Innovation
- Equity participation through stock options for shared company success
- Unlimited vacation policy based on mutual trust and responsibility
- Remote-first workforce with 52% fully remote; hybrid options available in London, Austin, and Sydney
- Flexible work model allowing autonomy in work style and location
- Personalized career development plans called 'Sherpa plans' for professional growth
- Monthly dedicated days for innovation and skill development
- Comprehensive family leave: up to six months fully paid maternity and two months paternity leave
- One-time $200 stipend for home office setup
- Welcome gift of $70 for company merchandise
- Paid day off to celebrate your birthday
- Frequent team events including seasonal parties, offsites, and monthly meetups
- Quarterly paid volunteer days to support community initiatives
Work Arrangement
Remote-first
Team
Engineering team focused on data acquisition and anti-bot systems
Interviews
Two-stage interview process
Start Date
As soon as possible
