Apps similar to Website Crawler include Pingdom. It's paid, but Xenu's Link Sleuth and ContentSwift are free. Other options are Screaming Frog SEO Spider, KWT Spider, SEO PowerSuite and SEO Tracer. SEO Tools like Website Crawler are a crowded field, with more than 50 alternatives for the web, Windows, Mac, Linux and Android.
InterroBot combines a desktop web crawler with full-text and field searching to help you get answers to just what the heck is going on with your website.
Create Sitemaps with the DYNO Mapper Visual Sitemap Generator. You can perform a Content Audit and display your Content Inventory along side Google Analytics for an easy Content Inventory Analysis and Content Strategy.
Boost your SEO, speed and security: Checkbot for Chrome crawls your site to test you’re following over 50+ best practices. Test 1,000s of pages in minutes for broken links, duplicate content, invalid HTML, insecure forms, redirect chains and more.
Australia
Sitebulb is an extremely powerful website auditor with the world's most insightful reporting system, winner of "Best Search Software Tool" at the 2018 UK Search Awards and the US Search Awards.
United Kingdom
Vovsoft SEO Checker is an easy to use website crawler, able to scan both small and large websites efficiently, while allowing you to find broken links, analyze the results in real-time, gather on-page SEO data, distinguish internal and external links, classify dofollow and...
Türkiye
The bulk version of Google's URL Inspection tool — official GSC indexation statuses for your entire site, not one URL at a time.
France
EU
Site Visualizer is a website crawling tool that visualizes a website's structure and shows a site as a set of pages and their outbound and inbound links. The crawler gathers all SEO-related parameters of every URL within a site.
Japan
Create visual HTML site maps and XML sitemaps for search engines of any web site quickly and easily. Try now - free online trial. PowerMapper is an automatic site map creation tool for information architects, usability analysts and web developers.
Excel plugin for working with online marketing. Create SEO reports and dashboards. More than 100 functions for growth hacking your company to the top.
SwedenEU
DeepCrawl is the world's most comprehensive website crawler. Analyse your website architecture to understand and monitor technical issues to improve SEO performance.
