Free crawl tools or service for developers
A collection of free crawl app, tools or service for developers

Puppeteer
Most things that you can do manually in the browser can be done using Puppeteer
Tags: screenshots, ui-testing, crawl

Octoparse
A Free, Simple, and Powerful Web Scraping Tool. Automate Data Extraction from websites within clicks without coding.
Tags: crawl, scraping
Free Offer:
Unlimited pages per crawl
Unlimited computers
10,000 records per export
2 concurrent local run
10 Crawlers