StormCrawler Alternatives

StormCrawler is described as 'open source SDK for building distributed web crawlers with Apache Storm. The project is under Apache license v2 and consists of a collection of reusable resources and components, written mostly in Java' and is an app. There are eight alternatives to StormCrawler for a variety of platforms, including Windows, Linux, Mac, Web-based and BSD apps. The best StormCrawler alternative is Scrapy, which is both free and Open Source. Other great apps like StormCrawler are Heritrix, Lookyloo, Mixnode and Apache Nutch.

StormCrawler alternatives page was last updated

StormCrawler

Free • Open Source

StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm. The project is under Apache...

More about StormCrawler

Scrapy
Is this is a good alternative?
Yes
No
Free • Open Source
Web Scraping Tool
Mac
Windows
Linux
BSD
86 Scrapy alternatives
Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...
- - Scrapy is the most popular Windows, Mac & Linux alternative to StormCrawler.
- - Scrapy is the most popular Open Source & free alternative to StormCrawler.
Suggest and vote on features
Scrapy Features
1. Command line interfaceScrapy either have CLI support or is a CLI-only app.
Data Mining
Fast motion
Screen scraping
Heritrix
Is this is a good alternative?
Yes
No
Free • Open Source
Mac
Windows
Linux
12 Heritrix alternatives
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Suggest and vote on features
Heritrix Features
WARC Output
Lookyloo
Is this is a good alternative?
Yes
No
Free • Open Source
Web Scraping Tool
Windows
Linux
Online
51 Lookyloo alternatives
Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
- - Lookyloo is the most popular Web-based alternative to StormCrawler.
Suggest and vote on features
Lookyloo Features
Tree map
Tree structure
Mixnode
Is this is a good alternative?
Yes
No
Paid • Proprietary
Online
23 Mixnode alternatives
Mixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web.
- - Mixnode is the most popular commercial alternative to StormCrawler.
Suggest and vote on features
Mixnode Features
Content-Type Filtering
URL Filtering
Data-management
WARC Output
Support for Amazon S3
Opinions about Mixnode as a Alternative to StormCrawler
Almost everyone thinks Mixnode is a great StormCrawler alternative.
Apache Nutch
Is this is a good alternative?
Yes
No
Free • Open Source
Web Scraping Tool
Mac
Windows
Linux
8 Apache Nutch alternatives
Apache Nutch is a highly extensible and scalable open source web crawler software project.
Suggest and vote on features
Apache Nutch Features
1. Extensible by Plugins/ExtensionsApache Nutch can be extended with add-ons, plugins and extensions.
Java based
Scalable
Add a screenshot
ACHE Crawler
Is this is a good alternative?
Yes
No
Free • Open Source
Web Scraping Tool
Mac
Windows
Linux
8 ACHE Crawler alternatives
ACHE is a web crawler for domain-specific search.
ACHE Crawler has no features, suggest some!
Add a screenshot
Crawlbase
Is this is a good alternative?
Yes
No
Freemium • Proprietary
Web Scraping Tool
Online
66 Crawlbase alternatives
Crawlbase, formerly ProxyCrawl, helps you stay anonymous while crawling the web, web crawling protection the way it should be.
Suggest and vote on features
Crawlbase Features
Free API
Anonymous web scraping
Crawler
Add a screenshot
Kaddara
Is this is a good alternative?
Yes
No
Paid • Proprietary
Web Scraping Tool
Software as a Service (SaaS)
78 Kaddara alternatives
Kaddara is a platform designed for professionals who need fresh leads to run their business and whose business is affected by how competitors operate.
- - Kaddara is the most popular SaaS alternative to StormCrawler.
Kaddara has no features, suggest some!