Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...
Cloud platform enabling automated data extraction, web crawling, and browser workflow automation using reusable acts, headless browser support, advanced scheduling, persistent storage, API integrations, modular design and scalable resource management.
Czechia
EU
Describe the data you need in plain words — Foxpull crawls it live, prices it up front, and delivers a clean spreadsheet on a schedule.
United Kingdom
API for website crawling, advanced scraping, and structured data extraction. Transforms multi-page online content into markdown or structured data, automates dynamic site handling, supports batch URL processing, and enables direct integration with AI pipelines.
United States
Anakin.io is a web scraping and structured data extraction API built for developers and AI teams. It converts any website into clean Markdown or JSON with a single API call - handling JavaScript rendering, anti-bot bypass, proxy rotation, and authenticated scraping (behind login...
Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.
Mexico
Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.
India
