Apps with 'website-crawler' feature Page 2 of 2

All apps in Apps with 'website-crawler' feature category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. Looksy is an advanced web scraper that uses smart search tools, recursive URL discovery, multithreading, human behaviour emulation, and intelligent filename guessing to efficiently find and download images and other files.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Windows
    Main Window
    Advanced Options 1
    Advanced Options 2
    +1
    Advanced Options 3
    3 alternatives
  2. FandangoSEO icon
     1 like

    FandangoSEO is an SEO Cloud tool that consists of a Crawler, a Log Monitoring, and a Competitive Analysis Tool. It provides valuable reports to master SEO strategies, improve the crawl budget, and increase the mobile and desktop traffic.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Architecture Map
    Architecture map
    Crawling errors
    +4
    Log Analysis
  3. This is a web-based application that reviews web pages and reports URL errors from webpage, image, iframe URLs including broken links, timeout links, redirection loops, mixed content errors, DNS errors, server errors.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    SiteCozy broken link checker screenshot 1
    SiteCozy broken link checker screenshot 1
    SiteCozy broken link checker screenshot 2
    +2
    SiteCozy broken link checker screenshot 3
  4. IziSEO icon
     1 like

    IziSEO is a website crawler that quickly identifies on-page and on-site SEO problems which could prevent you from ranking high in search engines.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Windows
    IziSEO main interface after a website is crawled
    Crawler's behaviour settings
    Keyword density and keywords highlighted in the text
    +4
    Page level tree
  5. Sitemapgenerator.ai crawls any website and generates accurate, up-to-date XML sitemaps in seconds — no manual upkeep required. Beyond basic sitemap creation, it runs full URL health checks, flagging broken links, redirects, and indexing issues before they hurt your SEO.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    An interactive map of the site's real structure, built from the live crawl — not just a flat URL list. Each node shows its HTTP status (200 OK) and indexing state at a glance.
    The Sitemapgenerator.ai homepage, where users enter their URL to start a crawl. The tool generates an accurate XML sitemap, checks every discovered URL for health issues (broken links, redirects, errors), and surfaces indexing visibility across both traditional Google search and AI search crawlers.
    8 alternatives