@harshvz/crawler Alternatives

@harshvz/crawler is described as 'A flexible web crawler and scraping tool using Playwright, supporting both BFS and DFS crawling strategies with screenshot capture and structured output. Installable via npm and usable both as a CLI and programmatically' and is an app. There are more than 25 alternatives to @harshvz/crawler for a variety of platforms, including Web-based, Windows, Linux, Mac and SaaS apps. The best @harshvz/crawler alternative is UI.Vision RPA, which is both free and Open Source. Other great apps like @harshvz/crawler are Scrapy, Otto, Reworkd and Portia.

More about @harshvz/crawler
Copy a direct link to this comment to your clipboard
@harshvz/crawler alternatives page was last updated

Alternatives list

  1. UI.Vision RPA icon

    UI.Vision RPA

     120 likes

    Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).

    144 UI.Vision RPA alternatives

    Cost / License

    • Freemium (Pay once)
    • Open Source

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    • Google Chrome
    • Mozilla Firefox
    UI.Vision RPA software is a browser extension, but it can do desktop automation as well!
     

    • UI.Vision RPA is the most popular Windows, Mac & Linux alternative to @harshvz/crawler.

    • UI.Vision RPA is the most popular Open Source & free alternative to @harshvz/crawler.

    • UI.Vision RPA is Freemium and Open Source@harshvz/crawler is Free and Open Source
  2. Scrapy icon

    Scrapy

     104 likes

    Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

    105 Scrapy alternatives

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
    Scrapy screenshot 1
     
  4. Otto icon

    Otto

     7 likes

    Leverage AI agents through Otto's native table interface for automating manual research, enriching lists, conducting company research, and analyzing documents efficiently with customizable column prompts and autofill capabilities.

    Cost / License

    • Freemium (Subscription)
    • Proprietary

    Application type

    Platforms

    • Online
    Otto screenshot 1
     

    • Otto is the most popular Web-based alternative to @harshvz/crawler.

    • Otto is Freemium and Proprietary@harshvz/crawler is Free and Open Source
  5. Ad
    Screenshot
    ScrapingBee icon
    ScrapingBee

    ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless i...

    https://www.scrapingbee.com
    Learn More
  6. Reworkd icon

    Reworkd

     8 likes

    Reworkd allows for effortless web data extraction at scale without the need for coding or maintenance. It automates the entire web data pipeline, scanning websites, generating code, running extractors, validating results, and outputting data.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
    Reworkd screenshot 1
     

    • Reworkd is the most popular commercial alternative to @harshvz/crawler.

    • Reworkd is Paid and Proprietary@harshvz/crawler is Free and Open Source
  7. Portia icon

    Portia

     62 likes

    Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

    Cost / License

    Application type

    Alerts

    • Discontinued

    Platforms

    • Linux
    • Vagrant
    • Docker
    Portia screenshot 1
     
  8. Octoparse icon

    Octoparse

     20 likes

    Octoparse is a no-code web scraping tool. It provides both free pre-made scraper templates and custom scraping features with which people without coding knowledge can extract various web data with simple point-and-click.

    119 Octoparse alternatives

    Cost / License

    • Freemium (Subscription)
    • Proprietary

    Application type

    Platforms

    • Mac
    • Windows
    Octoparse screenshot 1
     
  10. import.io icon

    import.io

     46 likes

    import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.

    Cost / License

    • Pay once
    • Proprietary

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    import.io screenshot 1
     
  11. Lookyloo icon

    Lookyloo

     4 likes

    Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Windows
    • Linux
    • Online
    Lookyloo screenshot 1
     
  12. Apify icon

    Apify

     18 likes

    Cloud platform enabling automated data extraction, web crawling, and browser workflow automation using reusable acts, headless browser support, advanced scheduling, persistent storage, API integrations, modular design and scalable resource management.

    108 Apify alternatives

    Cost / License

    • Freemium (Subscription)
    • Open Source

    Application type

    Platforms

    • Online
    Web scraper results
     
  13. ParseHub icon

    ParseHub

     67 likes

    ParseHub is a web scraping tool built to handle the modern web.

    You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

    ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

    97 ParseHub alternatives

    Cost / License

    • Freemium (Pay once)
    • Proprietary

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    ParseHub scraping Airbnb
     
  14. artoo.js icon

    artoo.js

     4 likes

    artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    • Self-Hosted
    • Google Chrome
    • JavaScript
    • Node.JS
    artoo.js screenshot 1
     

    • artoo.js is the most popular Self-Hosted alternative to @harshvz/crawler.

    • artoo.js is Free and Open Source@harshvz/crawler is also Free and Open Source
  15. ScrapingBee icon

    ScrapingBee

     2 likes

    ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

    90 ScrapingBee alternatives

    Cost / License

    • Subscription
    • Proprietary

    Application type

    Platforms

    • Software as a Service (SaaS)
    ScrapingBee screenshot 1
     

    • ScrapingBee is the most popular SaaS alternative to @harshvz/crawler.

    • ScrapingBee is Paid and Proprietary@harshvz/crawler is Free and Open Source
12 of 30 @harshvz/crawler alternatives