Web Scraping Tools

Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

iMacros was designed to automate the most repetitious tasks on the web. If there’s an activity you have to do repeatedly, just record it in iMacros. The next time you need to do it, the entire macro will run at the click of a button!

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.

Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.

A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.

Cloud-based platform for extracting data and automating website workflows, featuring headless browser support, advanced web crawling, reusable code acts and scalable storage.

ParseHub is a web scraping tool built to handle the modern web.

You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

Minexa.ai is a next-generation tool that makes web scraping faster and more affordable with an AI-powered solution no other alternative has. Unlike others that require constant tweaking, struggle under heavy loads, or charge extra for natural language processing, Minexa adapts...

ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

Best Web Scraping API. ZenRows handles rotating proxies, headless browsers, CAPTCHAs and more for you. Easily collect content from any website with a single API call.

A web & data scraping tool extracting Google Maps, Google Play, and Amazon reviews, supporting various data formats through a user-friendly interface.

Facilitates web scraping and lead generation using no-code bots across LinkedIn, Twitter, Facebook, and more. Cloud-based APIs enhance productivity.

The most powerful online cloud based download tool for websites, it copy and download all links from a website and can crawl link structure.

Diggernaut is a cloud-based service for web scraping, data extraction, and other ETL tasks. Schedule and run your scrapers in the cloud or compile and run on your PC.

Oxylabs is the leading global provider of premium proxies and data scraping solutions for large-scale web intelligence collection.

Scrape-It.Cloud is a comprehensive web scraping API designed to empower businesses with seamless data extraction from websites. With our user-friendly API, you can effortlessly gather structured data, such as product information, pricing details, customer reviews, and more.

Content Grabber is used for web scraping and web automation. It can extract content from almost any website and save it as structured data in a format of your choice, including Excel reports, XML, CSV and most databases.

Effortless scalable web scraping with built-in IP rotation, headless browsers, and CAPTCHA management, perfect for monitoring eCommerce, SERP, and more.

Monitor webpages and receive freshly scraped data everytime the page changes to a webhook of your choice.

Crawlbase, formerly ProxyCrawl, helps you stay anonymous while crawling the web, web crawling protection the way it should be.

Scraperr is a self-hosted web application that allows users to scrape data from web pages by specifying elements via XPath. Users can submit URLs and the corresponding elements to be scraped, and the results will be displayed in a table.