Web Scraping Tools

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).

Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

Cloud-based platform for extracting data and automating website workflows, featuring headless browser support, advanced web crawling, reusable code acts and scalable storage.

iMacros was designed to automate the most repetitious tasks on the web. If there’s an activity you have to do repeatedly, just record it in iMacros. The next time you need to do it, the entire macro will run at the click of a button!

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

AI-powered web data extraction platform for turning websites into structured, reliable data with no-code tools, monitoring, and APIs.

A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.

ParseHub is a web scraping tool built to handle the modern web.

You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

Flyto2 helps you automate repetitive browser tasks without writing code. Record your actions once — clicking buttons, filling forms, navigating pages — and Flyto2 learns to

artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.

ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

Minexa.ai is a next-generation tool that makes web scraping faster and more affordable with an AI-powered solution no other alternative has. Unlike others that require constant tweaking, struggle under heavy loads, or charge extra for natural language processing, Minexa adapts...

Best Web Scraping API. ZenRows handles rotating proxies, headless browsers, CAPTCHAs and more for you. Easily collect content from any website with a single API call.

Facilitates web scraping and lead generation using no-code bots across LinkedIn, Twitter, Facebook, and more. Cloud-based APIs enhance productivity.

A source-level stealth Chromium browser for Playwright, Puppeteer, Selenium/CDP, web scraping, QA, monitoring, and AI-agent automation, with local and self-managed deployment.

Offers premium proxies, AI-powered web scraping tools, a global pool of over 102 million IPs, automated infrastructure, datasets, robust management, and custom APIs.

Convert any website into a CLI & run Browser Use on your logged-in Chrome. Turn websites, browser sessions, Electron apps, and local tools into deterministic interfaces for humans and AI agents. Or run Browser Use against any page — navigate, fill forms, click, extract...

Moli is a production-ready headless browser for AI agents. Its on-demand layout and rendering design combines a complete browser runtime with a lightweight resource footprint.

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Diggernaut is a cloud-based service for web scraping, data extraction, and other ETL tasks. Schedule and run your scrapers in the cloud or compile and run on your PC.

Effortless scalable web scraping with built-in IP rotation, headless browsers, and CAPTCHA management, perfect for monitoring eCommerce, SERP, and more.

Cockroach Crawler is a governed web acquisition and extraction layer for AI agents. It supports bounded public-web crawling, searchable site maps, robots handling, JavaScript rendering, readable text and Markdown, JSON and JSONL, structured fields, CSS, XPath, restricted-regex...

Anakin.io is a web scraping and structured data extraction API built for developers and AI teams. It converts any website into clean Markdown or JSON with a single API call - handling JavaScript rendering, anti-bot bypass, proxy rotation, and authenticated scraping (behind login...