Apps with 'Web Crawler' feature Page 3 of 4

Enriched and structured information about every host on the Internet. Non-intrusive internet scanner, whois, domain names & SSL certs database.

Dexi is the most comprehensive web data processing tool for professionals. Extract, enrich & connect any data source to any other data source. Also known to be most advanced web scraping tool. All available in your browser - try it for free.

Web scraping API with a flexible usage-based pricing that offers real browsers, rotating mobile proxies, and JavaScript rendering.

The primary focus of this web crawler is to make it easier for enterprise search integrators and developers when dealing with all types of crawling requirements. We wanted for ourselves something very portable, extensible, modular, and working with most search engines.

Site Analyzer is the most efficient website analyzer platform so you can improve your online visibility and rank at the top of search engines.

A web scraping service to collect data from websites, without any programming or DIY tools.

The Audisto Crawler is a website crawling tool with a strong focus on SEO. It automatically detects and analyses all URLs from a website and points out optimization potential.

Best Rotating Proxy & Scraping API Alternative

You don't need to spend hours to create your own IP rotation rules and pay for different services. Just use scrape.do and only pay for successful requests. It's very easy and fast!.

Comprehensive network management on Android with real-time monitoring, advanced tools, graphs, device organization, VPN remote access, and premium scanner features.

Datahut is a web scraping service that helps companies gather data from web pages. It allows you to access web data at an affordable cost and eliminates vendor lock-in by using open source technologies. The Best part - 100% money back guarantee.

ScrapeWise is a no-code web scraping infrastructure platform that lets business teams extract structured data from any publicly accessible website without writing code or depending on developers.

WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files.

Botsol Google Maps Crawler automates extracting business information from Google Maps for lead generation, local SEO, and market research. Search Google Maps the way you normally would, start the crawler, and it extracts business names, addresses, phone numbers, websites...

Turn any website into data with ScrapeUp API, which handles browsers, proxy rotation, and CAPTCHAs so developers can easily scrape any webpages with a single API call.

Broken Link Scan is a web-based link checker and site crawler. Enter any URL and it will crawl up to 500 pages for free, verifying every link, image, media resource, redirect chain and SSL certificate. Results are quick, with a health-score dashboard and an internal-vs-external...

Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.

SeekStorm - Search as a Service: high-performance search API provides full-text, real-time, instant search & crawling.

The world's most powerful search. Business-grade search and crawling for any web data.

Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.

ACHE is a web crawler for domain-specific search.

Ragfeed is a web-data API for AI applications. It fetches public web pages, PDFs and search results and returns them as clean Markdown, structured JSON or ready-made chunks for vector databases, with navigation, ads and boilerplate removed.

MediaPocket is an applications that can help you to download photos, videos and even entire pages from your favorite blogs in an instant. All you have to do is type a suitable blog address in the designated field and click the "Play" button available in the main...

Looksy is an advanced web scraper that uses smart search tools, recursive URL discovery, multithreading, human behaviour emulation, and intelligent filename guessing to efficiently find and download images and other files.

MainREST - web scrapping platform (framework) with API access.

Automated website health monitoring — broken links, SEO, accessibility, performance and security checks on a schedule, with email, webhook, CSV and PDF reports.