Zyte is looking for a Python Developer to build web crawlers that harness our platform, which powers crawls of over 3 billion pages each month. You’ll work on web crawler development with Scrapy, our flagship, open source project.
What You'll Do
- Design, develop and maintain Scrapy web crawlers.
- Leverage the Zyte platform and our open source projects to perform distributed information extraction, retrieval and data processing.
- Identify and resolve performance and scalability issues with distributed crawling at scale.
- Help identify, debug and fix problems with open source projects, including Scrapy.
What We're Looking For
- 3+ years of software development experience in Python.
- Solid Python knowledge.
- Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
- Good communication in written and spoken English.
- Availability to work full time.
Nice to Have
- Scrapy experience is a big plus.
- Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc).
- Proficient English.
Technical Stack
- Python
- Scrapy
- Linux/UNIX
- HTTP
- HTML
- Javascript
Team & Environment
You will be part of a globally distributed Delivery team within Zyte, a company of over 240 Zytans.
Benefits & Compensation
- Become part of a self-motivated, progressive, multi-cultural team.
- Have the freedom and flexibility to work from where you do your best work.
- Attend conferences and meet with team members from across the globe.
- Work with cutting-edge open source technologies and tools.
- 35 days paid holidays.
Work Mode
This is a remote role open globally; the team works from over 28 countries.
Zyte is an equal opportunity employer.
