StormCrawler Alternatives

StormCrawler is described as 'Open source SDK for building distributed web crawlers with Apache Storm. The project is under Apache license v2 and consists of a collection of reusable resources and components, written mostly in Java' and is an app. There are nine alternatives to StormCrawler for a variety of platforms, including Windows, Linux, Mac, Web-based and BSD apps. The best StormCrawler alternative is Scrapy, which is both free and Open Source. Other great apps like StormCrawler are Lookyloo, Flyscrape, Crawlbase and Heritrix.

StormCrawler iconStormCrawler
  2
  • Free • Open Source
  • ...

StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm. The project is under Apache...

More about StormCrawler
More about StormCrawler
StormCrawler alternatives page was last updated Nov 14, 2023
  Suggest Alternatives
  1. Scrapy icon
    Scrapy icon

    Scrapy

     102 likes
    Copy a direct link to this comment to your clipboard

    Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

    95 Scrapy alternatives
    Scrapy screenshot 1

    License model

    • Free • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD

    Scrapy Features

    1.  Command line interface
    2.  Data Mining
    3.  Fast motion
    4.  Screen Scraping
    Scrapy screenshot 1
    Scrapy iconStormCrawler Icon

    Scrapy VS StormCrawler

    Is Scrapy a good alternative to StormCrawler?
     

    • Scrapy is the most popular Windows, Mac & Linux alternative to StormCrawler.

    • Scrapy is the most popular Open Source & free alternative to StormCrawler.

    • Scrapy is Free and Open SourceStormCrawler is also Free and Open Source
  2. Lookyloo icon
    Lookyloo icon

    Lookyloo

     4 likes
    Copy a direct link to this comment to your clipboard

    Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

    57 Lookyloo alternatives
    Lookyloo screenshot 1

    License model

    • Free • Open Source

    Application type

    Platforms

    • Windows
    • Linux
    • Online

    Lookyloo Features

    1.  Tree map
    2.  Security Testing
    3.  Tree structure
    Lookyloo iconStormCrawler Icon

    Lookyloo VS StormCrawler

    Is Lookyloo a good alternative to StormCrawler?
     

    • Lookyloo is the most popular Web-based alternative to StormCrawler.

    • Lookyloo is Free and Open SourceStormCrawler is also Free and Open Source
  4. Flyscrape icon
    Flyscrape icon

    Flyscrape

     6 likes
    Copy a direct link to this comment to your clipboard

    Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.

    58 Flyscrape alternatives
    Flyscrape screenshot 1

    License model

    • Free • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux

    Flyscrape Features

    1.  Support for scripting
    Flyscrape iconStormCrawler Icon

    Flyscrape VS StormCrawler

    Is Flyscrape a good alternative to StormCrawler?
     
  5. Crawlbase icon
    Crawlbase icon

    Crawlbase

     3 likes
    Copy a direct link to this comment to your clipboard

    Crawlbase, formerly ProxyCrawl, helps you stay anonymous while crawling the web, web crawling protection the way it should be.

    69 Crawlbase alternatives

    License model

    • Freemium • Proprietary

    Application type

    Platforms

    • Online

    Crawlbase Features

    1.  Free API
    2.  Crawler
    Crawlbase iconStormCrawler Icon

    Crawlbase VS StormCrawler

    Is Crawlbase a good alternative to StormCrawler?
     
  6. Heritrix icon
    Heritrix icon

    Heritrix

     5 likes
    Copy a direct link to this comment to your clipboard

    Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

    15 Heritrix alternatives
    Heritrix screenshot 1

    License model

    • Free • Open Source

    Platforms

    • Mac
    • Windows
    • Linux

    Heritrix Features

    1.  WARC Output
    Heritrix iconStormCrawler Icon

    Heritrix VS StormCrawler

    Is Heritrix a good alternative to StormCrawler?
     
  7. Mixnode icon
    Mixnode icon

    Mixnode

     38 likes
    Copy a direct link to this comment to your clipboard

    Mixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web.

    25 Mixnode alternatives
    Main Page

    License model

    Application type

    Platforms

    • Online

    Mixnode Features

    1.  Content-Type Filtering
    2.  URL Filtering
    3.  Data-management
    4.  WARC Output
    5.  Support for Amazon S3
    Mixnode iconStormCrawler Icon

    Mixnode VS StormCrawler

    Is Mixnode a good alternative to StormCrawler?
     

    • Almost everyone thinks Mixnode is a great StormCrawler alternative.

    • Mixnode is the most popular commercial alternative to StormCrawler.

    • Mixnode is Paid and ProprietaryStormCrawler is Free and Open Source
  9. Apache Nutch icon
    Apache Nutch icon

    Apache Nutch

     2 likes
    Copy a direct link to this comment to your clipboard

    Apache Nutch is a highly extensible and scalable open source web crawler software project.

    9 Apache Nutch alternatives

    License model

    • Free • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux

    Properties

    1.  Extensible by Plugins/Extensions

    Features

    1.  Java based
    2.  Scalable
    Apache Nutch iconStormCrawler Icon

    Apache Nutch VS StormCrawler

    Is Apache Nutch a good alternative to StormCrawler?
     
  10. ACHE Crawler icon
    ACHE Crawler icon

    ACHE Crawler

     2 likes
    Copy a direct link to this comment to your clipboard

    ACHE is a web crawler for domain-specific search.

    9 ACHE Crawler alternatives

    License model

    • Free • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    ACHE Crawler iconStormCrawler Icon

    ACHE Crawler VS StormCrawler

    Is ACHE Crawler a good alternative to StormCrawler?
     
  11. Kaddara icon
    Kaddara icon

    Kaddara

     Like this app
    Copy a direct link to this comment to your clipboard

    Kaddara is a platform designed for professionals who need fresh leads to run their business and whose business is affected by how competitors operate.

    77 Kaddara alternatives
    Kaddara screenshot 1

    License model

    Application type

    Platforms

    • Software as a Service (SaaS)
    Kaddara screenshot 1
    Kaddara screenshot 2
    +1
    Kaddara screenshot 3
    Kaddara iconStormCrawler Icon

    Kaddara VS StormCrawler

    Is Kaddara a good alternative to StormCrawler?
     

    • Kaddara is the most popular SaaS alternative to StormCrawler.

    • Kaddara is Paid and ProprietaryStormCrawler is Free and Open Source
9 of 9 StormCrawler alternatives