Zyte is looking for a Python Developer to build web crawlers leveraging the Zyte platform, which powers crawls of over 3 billion pages per month. You’ll focus on web crawler development with Scrapy, Zyte's flagship open source project, as part of a globally distributed team.
What You'll Do
- Design, develop and maintain Scrapy web crawlers.
- Leverage the Zyte platform and open source projects to perform distributed information extraction, retrieval and data processing.
- Identify and resolve performance and scalability issues with distributed crawling at scale.
- Help identify, debug and fix problems with open source projects, including Scrapy.
What We're Looking For
- 3+ years of software development experience in Python.
- Solid Python knowledge.
- Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
- Good communication in written and spoken English.
- Availability to work full time.
Nice to Have
- Scrapy experience is a big plus.
- Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc).
- Proficient English.
Technical Stack
- Python
- Scrapy
- Linux/UNIX
- HTTP
- HTML
- Javascript
Team & Environment
You'll join a globally distributed delivery team of over 240 Zytans.
Benefits & Compensation
- Become part of a self-motivated, progressive, multi-cultural team.
- Have the freedom and flexibility to work from where you do your best work.
- Attend conferences and meet with team members from across the globe.
- Work with cutting-edge open source technologies and tools.
- 35 days paid holidays.
Work Mode
This is a fully remote role for global candidates.
