Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

Leverage AI agents through Otto's native table interface for automating manual research, enriching lists, conducting company research, and analyzing documents efficiently with customizable column prompts and autofill capabilities.

Reworkd allows for effortless web data extraction at scale without the need for coding or maintenance. It automates the entire web data pipeline, scanning websites, generating code, running extractors, validating results, and outputting data.

Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.

import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.

Apify is a web scraping and automation platform - it extracts data from websites, crawls lists of URLs and automates workflows on the web. Turn any website into an API!.

A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.

ParseHub is a web scraping tool built to handle the modern web.

You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.