Apps with 'Crawler' feature

  1. Pulno is a website audit tool which checks for SEO related issues and sends comprehensible tips to improve on-page SEO with page speed optimizer (CSS and image file optimization), meta tags and unique text analyzer.
    • Mac
    • Windows
    • Linux
    import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.
    show more


  2. Netpeak Spider is a desktop tool which crawls your website like a search engine robot and detects key SEO issues that influence the website’s visibility in SERP. Netpeak Spider is available on Windows only. This tool allows you to:
    show more
    • FreeProprietary
    • Online
    A web-based crawler with real-time crawl feedback. Advanced, fast & flexible SEO website crawler that can help identify technical or architectural issues with any site.
    No screenshots yet
    • FreeProprietary
    • Mac
    • Windows
    • Linux
    • Online
    Extracty can extract any web data and create an API to the webpage's information.

    Discontinued

    The company do not host an online backend anymore, so it's not possible to execute any scripts online. The website has a functional front end.

    • FreeProprietary
    • Online
    Common Crawl builds and maintains an open repository of web crawl data that can be accessed and analyzed by anyone
    • FreemiumProprietary
    • Windows
    Turn web page content into structured data all without coding. *Important* - Mozenda uses a Windows application that must be installed on Windows Vista or newer
    No screenshots yet
  3. Octoparse is a modern visual web data extraction software. Both experienced and inexperienced users would find it easy to use Octoparse to bulk extract information from websites, for most of scraping tasks no coding needed.
    show more
    • Online
    • Software as a Service (SaaS)
    Main features of ScrapeHero: - No Software, No Programming, No DIY tools - Crawl complex websites with ease - Never worry about data quality - Perform complex data transformations - Real-time Website Scraping API for Price Monitoring ScrapeHero provides reliable web...
    No screenshots yet