The Screaming Frog SEO Spider is a small desktop program (PC or Mac) which crawls websites’ links, images, CSS, script and apps from an SEO perspective.

Xenus Link Sleuth checks Web sites for broken links. Link verification is done on "normal" links, images, frames, plug-ins, backgrounds, local image maps, style sheets, scripts and java applets.

import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.

A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.

Netpeak Spider is an SEO crawler for a day-to-day SEO audit, fast issue check, comprehensive analysis, and website scraping.

Diggernaut is a cloud-based service for web scraping, data extraction, and other ETL tasks. Schedule and run your scrapers in the cloud or compile and run on your PC.

Discover broken links, uncover missing page titles, duplicate content and identify other problems with our SEO crawler software.

Seobility allows you to quickly audit and review a website from an onsite SEO perspective. You will get valuable insights to improve your search engine optimization. It is free for small websites with up to 1.000 pages.

ZEFO is an advanced software program offering exclusive tools for online marketing. The system was developed in 2011 and has been used as a professional tool by SEOs and digital marketing specialists ever since.

Pulno is a website audit tool which checks for SEO related issues and sends comprehensible tips to improve on-page SEO with page speed optimizer (CSS and image file optimization), meta tags and unique text analyzer.

SiteAnalyzer is a Web Crawler to scan the websites and check their technical and of SEO-parameters for errors and correct them effectively.

Rinkt it is free and extendable automation tool for desktop and web applications. It can learn and perform tasks and access all kinds of information sources, just as humans do.