A free in-depth website analyzer providing audits of security, performance, SEO, accessibility and other technical aspects. Available as a desktop application for Windows/macOS/Linux and as a CLI tool for advanced users and CI/CD processes. It also includes an offline web page exporter.
- SEO Tool
- Free • Open Source
- Mac
- Windows
- Linux
+9Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...
- Web Scraping Tool
- Free • Open Source
- Mac
- Windows
- Linux
- BSD
Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).
- Task Automation App
- Freemium • Open Source
- Mac
- Windows
- Linux
- Google Chrome
- Mozilla Firefox
Automate manual research with AI agents working through a native table interface, capable of data enrichment, company research, and document analysis.
- Web Scraping Tool
- Freemium • Proprietary
- Online
+4Reworkd allows for effortless web data extraction at scale without the need for coding or maintenance. It automates the entire web data pipeline, scanning websites, generating code, running extractors, validating results, and outputting data.
- Web Scraping Tool
- Paid • Proprietary
- Online
Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.
- Web Scraping Tool
- Free • Open Source
- Linux
- Vagrant
- Docker
+2Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
- Web Scraping Tool
- Free • Open Source
- Windows
- Linux
- Online
iMacros was designed to automate the most repetitious tasks on the web. If there’s an activity you have to do repeatedly, just record it in iMacros. The next time you need to do it, the entire macro will run at the click of a button!
- Task Automation App
- Free • Proprietary
- Google Chrome
Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.
- Web Scraping Tool
- Free • Open Source
- Mac
- Windows
- Linux
import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.
- Web Scraping Tool
- Paid • Proprietary
- Mac
- Windows
- Linux
+1Apify is a web scraping and automation platform - it extracts data from websites, crawls lists of URLs and automates workflows on the web. Turn any website into an API!.
- Web Scraping Tool
- Freemium • Open Source
- Online
A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.
- Web Scraping Tool
- Free Personal • Proprietary
- Windows
AI platform converting and analyzing audio, video, and text data, capturing insights from calls and meetings with integration across major conferencing platforms.
- Paid • Proprietary
- Online
- Software as a Service (SaaS)
ParseHub is a web scraping tool built to handle the modern web.
You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.
ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.
- Web Scraping Tool
- Freemium • Proprietary
- Mac
- Windows
- Linux
- Online
Minexa.ai is a next-generation tool that makes web scraping faster and more affordable with an AI-powered solution no other alternative has. Unlike others that require constant tweaking, struggle under heavy loads, or charge extra for natural language processing, Minexa adapts...
- Web Scraping Tool
- Paid • Proprietary
- Online
+1