Web Scraping Tools

Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).

Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

Cloud-based platform for extracting data and automating website workflows, featuring headless browser support, advanced web crawling, reusable code acts and scalable storage.

iMacros was designed to automate the most repetitious tasks on the web. If there’s an activity you have to do repeatedly, just record it in iMacros. The next time you need to do it, the entire macro will run at the click of a button!

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

AI-powered web data extraction platform for turning websites into structured, reliable data with no-code tools, monitoring, and APIs.

A free, fully-featured, and extensible tool for automating any web or desktop application. UiPath Studio Community is free for individual developers, small professional teams, education and training purposes.

Flyto2 helps you automate repetitive browser tasks without writing code. Record your actions once — clicking buttons, filling forms, navigating pages — and Flyto2 learns to

artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

ParseHub is a web scraping tool built to handle the modern web.

You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

Flyscrape is a standalone and scriptable web scraper, combining the speed of Go with the flexibility of JavaScript. — Focus on data extraction rather than request juggling.

ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

Minexa.ai is a next-generation tool that makes web scraping faster and more affordable with an AI-powered solution no other alternative has. Unlike others that require constant tweaking, struggle under heavy loads, or charge extra for natural language processing, Minexa adapts...

Best Web Scraping API. ZenRows handles rotating proxies, headless browsers, CAPTCHAs and more for you. Easily collect content from any website with a single API call.

Facilitates web scraping and lead generation using no-code bots across LinkedIn, Twitter, Facebook, and more. Cloud-based APIs enhance productivity.

Offers premium proxies, AI-powered web scraping tools, a global pool of over 102 million IPs, automated infrastructure, datasets, robust management, and custom APIs.

Diggernaut is a cloud-based service for web scraping, data extraction, and other ETL tasks. Schedule and run your scrapers in the cloud or compile and run on your PC.

Cockroach Crawler is a governed web acquisition and extraction layer for AI agents. It supports bounded public-web crawling, searchable site maps, robots handling, JavaScript rendering, readable text and Markdown, JSON and JSONL, structured fields, CSS, XPath, restricted-regex...

Effortless scalable web scraping with built-in IP rotation, headless browsers, and CAPTCHA management, perfect for monitoring eCommerce, SERP, and more.

Anakin.io is a web scraping and structured data extraction API built for developers and AI teams. It converts any website into clean Markdown or JSON with a single API call - handling JavaScript rendering, anti-bot bypass, proxy rotation, and authenticated scraping (behind login...

Content Grabber is used for web scraping and web automation. It can extract content from almost any website and save it as structured data in a format of your choice, including Excel reports, XML, CSV and most databases.

Get live-breaking news or search historical news data for the past 10 years from 100,000+ sources using the NewsData.io API. Collect the data in JSON or Excel Formats.

Get changes on any website as a News Feed in your Inbox.

Oglama is a privacy-first, community-driven web automation platform that enables users to automate everyday web tasks in a secure environment. It emphasizes collaborative workflows and user sovereignty over data.