StormCrawler Alternatives

    StormCrawler is described as 'open source SDK for building distributed web crawlers with Apache Storm. The project is under Apache license v2 and consists of a collection of reusable resources and components, written mostly in Java'. There are six alternatives to StormCrawler for Mac, Windows, Linux, Online / Web-based and BSD. The best alternative is Scrapy, which is both free and Open Source. Other great apps like StormCrawler are Mixnode (Paid), Heritrix (Free, Open Source), Apache Nutch (Free, Open Source) and ProxyCrawl (Freemium).

    This page was last updated Jul 6, 2018

    1. Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler.
      show more
    2. Mixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web.
      No screenshots yet
      Almost everyone thinks Mixnode is a great alternative to StormCrawler.


      • FreeOpen Source
      • Mac
      • Windows
      • Linux
      Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
    3. Apache Nutch is a highly extensible and scalable open source web crawler software project.
      No screenshots yet
    4. ProxyCrawl helps you stay anonymous while crawling the web, web crawling protection the way it should be.
      show more


      • FreeOpen Source
      • Mac
      • Windows
      • Linux
      ACHE is a web crawler for domain-specific search.
      No screenshots yet
    Showing 6 of 6 alternatives