AlternativeTo Logo

Apps with 'Website Crawler' feature

  1. HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.

    Suggest and vote on features

    Discontinued

    The last version (3.49-2) was released in May 2017.

    Screenshot
  2. Netpeak Spider is an SEO crawler for a day-to-day SEO audit, fast issue check, comprehensive analysis, and website scraping.

    Suggest and vote on features
    Screenshot


  3. A web-based crawler with real-time crawl feedback.

    Advanced, fast & flexible SEO website crawler that can help identify technical or architectural issues with any site.

    Suggest and vote on features
    No screenshots yet
  4. Mixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web.

    Suggest and vote on features
    Main Page
  5. Vovsoft SEO Checker is an easy to use website crawler, able to scan both small and large websites efficiently, while allowing you to find broken links, analyze the results in real-time, gather on-page SEO data, distinguish internal and external links, classify dofollow and...

    Suggest and vote on features
    Screenshot
  6. Boost your SEO, speed and security: Checkbot for Chrome crawls your site to test you’re following over 50+ best practices. Test 1,000s of pages in minutes for broken links, duplicate content, invalid HTML, insecure forms, redirect chains and more.

    Suggest and vote on features
    Screenshot
  7. Common Crawl builds and maintains an open repository of web crawl data that can be accessed and analyzed by anyone

    Suggest and vote on features
    Screenshot
  8. Seobility allows you to quickly audit and review a website from an onsite SEO perspective. You will get valuable insights to improve your search engine optimization. It is free for small websites with up to 1.000 pages.

    Suggest and vote on features
    Ranking Dashboard
  9. Discover broken links, uncover missing page titles, duplicate content and identify other problems with our SEO crawler software.

    Suggest and vote on features
    Screenshot
  10. Extracty can extract any web data and create an API to the webpage's information.

    Suggest and vote on features

    Discontinued

    The company do not host an online backend anymore, so it's not possible to execute any scripts online. The website has a functional front end.

    Screenshot
  11. DRKSpider is an open source website crawler (sitemap generator) and link checker.

    Suggest and vote on features
    Screenshot
  12. Site Visualizer is a website crawling tool that visualizes a website's structure and shows a site as a set of pages and their outbound and inbound links. The crawler gathers all SEO-related parameters of every URL within a site.

    Suggest and vote on features
    Pages and links of a website
  13. DeepCrawl is the world's most comprehensive website crawler. Analyse your website architecture to understand and monitor technical issues to improve SEO performance.

    Suggest and vote on features
    No screenshots yet
  14. FandangoSEO is an SEO Cloud tool that consists of a Crawler, a Log Monitoring, and a Competitive Analysis Tool. It provides valuable reports to master SEO strategies, improve the crawl budget, and increase the mobile and desktop traffic.

    Suggest and vote on features
    Architecture Map
  15. hextrakt is a strong SEO crawler for windows, which can crawl very big websites, thanks to its new adaptive & asynchronous technology. Free version is limited to 20 000 URLs, unlimited crawls, including powerful URL explorer and export.

    Suggest and vote on features
    hextrakt SEO crawler