@harshvz/crawler Alternatives

@harshvz/crawler is described as 'A flexible web crawler and scraping tool using Playwright, supporting both BFS and DFS crawling strategies with screenshot capture and structured output. Installable via npm and usable both as a CLI and programmatically' and is an app. There are more than 25 alternatives to @harshvz/crawler for a variety of platforms, including Web-based, Windows, Linux, SaaS and Mac apps. The best @harshvz/crawler alternative is Scrapy, which is both free and Open Source. Other great apps like @harshvz/crawler are UI.Vision RPA, Portia, Apify and Lookyloo.

Copy a direct link to this comment to your clipboard
@harshvz/crawler alternatives page was last updated

Alternatives list

  1. Scrapy icon
     107 likes

    Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

    123 Scrapy alternatives

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
     
  2. UI.Vision RPA icon
     122 likes

    Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).

    151 UI.Vision RPA alternatives

    Cost / License

    • Freemium
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Google Chrome
    • Mozilla Firefox
     
  3. Portia icon
     63 likes

    Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

    93 Portia alternatives

    Cost / License

    Application type

    Alerts

    • Discontinued

    Platforms

    • Linux
    • Vagrant
    • Docker
     
  4. Apify icon
     19 likes

    Cloud platform enabling automated data extraction, web crawling, and browser workflow automation using reusable acts, headless browser support, advanced scheduling, persistent storage, API integrations, modular design and scalable resource management.

    128 Apify alternatives

    Cost / License

    • Freemium
    • Open Source

    Application type

    Platforms

    • Online
     
  5. Lookyloo icon
     5 likes

    Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Windows
    • Linux
    • Online
     
  6. Import.io icon
     46 likes

    AI-powered web data extraction platform for turning websites into structured, reliable data with no-code tools, monitoring, and APIs.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
     
  7. artoo.js icon
     4 likes

    artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    • Self-Hosted
    • Google Chrome
    • JavaScript
    • Node.JS
     
  8. ParseHub icon
     67 likes

    ParseHub is a web scraping tool built to handle the modern web.

    You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

    ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

    Cost / License

    • Freemium
    • Proprietary

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
     
  9. ScrapingBee icon
     2 likes

    ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Software as a Service (SaaS)
     
  10. PhantomBuster icon
     3 likes

    PhantomBuster offers no-code, multi-platform bots compatible with major sites like LinkedIn and Twitter for web scraping and lead generation. Cloud APIs ensure seamless integration, boosting productivity and supporting custom API creation for bespoke automation solutions.

    Cost / License

    • Paid
    • Open Source

    Application type

    Platforms

    • Online
    • Mozilla Firefox
     
  11. Diggernaut icon
     33 likes

    Diggernaut is a cloud-based service for web scraping, data extraction, and other ETL tasks. Schedule and run your scrapers in the cloud or compile and run on your PC.

    Cost / License

    • Freemium
    • Proprietary

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    • Self-Hosted
     
  12. Anakin.io icon
     2 likes

    Anakin.io is a web scraping and structured data extraction API built for developers and AI teams. It converts any website into clean Markdown or JSON with a single API call - handling JavaScript rendering, anti-bot bypass, proxy rotation, and authenticated scraping (behind login...

    Cost / License

    Application type

    Platforms

    • Online
    • Software as a Service (SaaS)
     
12 of 30 @harshvz/crawler alternatives