Apps tagged with 'crawling'

All apps in Apps tagged with 'crawling' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. Netpeak Spider icon
     51 likes

    Netpeak Spider is an SEO crawler for a day-to-day SEO audit, fast issue check, comprehensive analysis, and website scraping.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Windows
    Netpeak Spider screenshot 1
    Netpeak Spider screenshot 1
    Netpeak Spider screenshot 2
    +2
    Netpeak Spider screenshot 3
    55 alternatives
  2. Crawlbase icon
     3 likes

    Crawlbase, formerly ProxyCrawl, helps you stay anonymous while crawling the web, web crawling protection the way it should be.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    81 alternatives
  3. Pulno icon
     40 likes

    Pulno is a website audit tool which checks for SEO related issues and sends comprehensible tips to improve on-page SEO with page speed optimizer (CSS and image file optimization), meta tags and unique text analyzer.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    • Software as a Service (SaaS)
    Pulno screenshot 1
    Pulno screenshot 1
    Pulno screenshot 2
    +3
    Pulno screenshot 3
    5.0
    Excellent12 reviews
  4.  9 likes

    A web-based crawler with real-time crawl feedback.

    Advanced, fast & flexible SEO website crawler that can help identify technical or architectural issues with any site.

    Cost / License

    • Free
    • Proprietary

    Application type

    Platforms

    • Online
  5. Ambar icon
     4 likes

    Ambar is a smart documents archive with automated crawling, OCR, deduplication and ultra-fast full-text search. Imagine having billion of files in different formats like xls, doc, txt, pdf, ppt, etc..., in any encoding.

    Cost / License

    • Freemium
    • Open Source (MIT)

    Alerts

    • Discontinued

    Platforms

    • Online
    • VirtualBox
    • Self-Hosted
    • Docker
    Instant Search
    Search throught Scanned Images (OCR functionality)
    Real-Time Statistics
    +2
    Dropbox Integration
    12 alternatives
  6. Checkbot icon
     4 likes

    Boost your SEO, speed and security: Checkbot for Chrome crawls your site to test you’re following over 50+ best practices. Test 1,000s of pages in minutes for broken links, duplicate content, invalid HTML, insecure forms, redirect chains and more.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    • Google Chrome
    Checkbot screenshot 1
    Checkbot screenshot 1
    Checkbot screenshot 2
    +1
    Checkbot screenshot 3
    59 alternatives
  7. Mixnode icon
     38 likes

    Mixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
    Main Page
    26 alternatives
  8. Site Visualizer is a website crawling tool that visualizes a website's structure and shows a site as a set of pages and their outbound and inbound links. The crawler gathers all SEO-related parameters of every URL within a site.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Windows
    Pages and links of a website
    Visual sitemap
    Website reports
    +3
    XML sitemap
  9. 80legs icon
     2 likes

    80legs offers powerful web crawling. Extract data from web pages, images, and any other online content. Start crawling websites now faster, easier, and with unlimited reach.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    58 alternatives
  10. Deepcrawl icon
     3 likes

    DeepCrawl is the world's most comprehensive website crawler. Analyse your website architecture to understand and monitor technical issues to improve SEO performance.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
  11. hextrakt icon
     2 likes

    hextrakt is a strong SEO crawler for windows, which can crawl very big websites, thanks to its new adaptive & asynchronous technology. Free version is limited to 20 000 URLs, unlimited crawls, including powerful URL explorer and export.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Windows
    hextrakt SEO crawler
  12. Catch Breaking Changes to Content, Code, & Design.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
  13. COPYTRACK icon
     Like

    COPYTRACK is a leading Berlin-based image monitoring & copyright enforcement solution provider. We use a combination of technologies, such as AI, Blockchain, and Big Data, to track the online usage of images and look after the registration and the further enforcement of...

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Software as a Service (SaaS)
    COPYTRACK screenshot 1
    10 alternatives
  14. Exa AI icon
     Like

    The world's most powerful search. Business-grade search and crawling for any web data.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Exa AI screenshot 1
    Exa AI screenshot 1
    Exa AI screenshot 2
    +1
    Exa AI screenshot 3
    17 alternatives
  15. TechSEO360 essentially offers crawling of huge websites, collects and shows just about any technical SEO related information you want and can create all types of sitemaps including XML with hreflang information, image, video and HTML/CSS/Javascript.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Mac
    • Windows
    TechSEO360 screenshot 1
    TechSEO360 screenshot 1
    TechSEO360 screenshot 2
    +6
    TechSEO360 screenshot 3
  16. Datoin icon
     1 like

    An enterprise grade, large scale web crawler and extraction engine built using Datoin Platform for all your Data Needs. Datoin platform is built on top of Apache Hadoop and customised Nutch crawler.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    1 alternatives
  17. SpeedProxies is always working hard to provide customers with the best proxy experience they can get. We offer the cleanest, hourly updated proxy pool available exclusively to you. Over 12M IPs are active worldwide. Flexible targeting by countries.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    SpeedProxies screenshot 1
    3 alternatives