Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

Reworkd allows for effortless web data extraction at scale without the need for coding or maintenance. It automates the entire web data pipeline, scanning websites, generating code, running extractors, validating results, and outputting data.

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.

import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.

Apify is a web scraping and automation platform - it extracts data from websites, crawls lists of URLs and automates workflows on the web. Turn any website into an API!.

A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.

ParseHub is a web scraping tool built to handle the modern web.

You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

Diggernaut is a cloud-based service for web scraping, data extraction, and other ETL tasks. Schedule and run your scrapers in the cloud or compile and run on your PC.

ScraperAPI is an API that helps developers easily build scalable web scrapers. Unlike proxy providers that just give you a list of IP addresses, Scraper API handles IP rotation, headless browsers, and CAPTCHAs so developers can get the HTML of any web page with a simple API call.