Apps with 'Web Crawler' feature Page 3 of 4

Site Analyzer is the most efficient website analyzer platform so you can improve your online visibility and rank at the top of search engines.

A web scraping service to collect data from websites, without any programming or DIY tools.

The Audisto Crawler is a website crawling tool with a strong focus on SEO. It automatically detects and analyses all URLs from a website and points out optimization potential.

Comprehensive network management on Android with real-time monitoring, advanced tools, graphs, device organization, VPN remote access, and premium scanner features.

Crawls a website and reports technical SEO and WCAG 2.2 accessibility issues, scored and ranked by what each fix is worth.

Datahut is a web scraping service that helps companies gather data from web pages. It allows you to access web data at an affordable cost and eliminates vendor lock-in by using open source technologies. The Best part - 100% money back guarantee.

ScrapeWise is a no-code web scraping infrastructure platform that lets business teams extract structured data from any publicly accessible website without writing code or depending on developers.

WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files.

Botsol Google Maps Crawler automates extracting business information from Google Maps for lead generation, local SEO, and market research. Search Google Maps the way you normally would, start the crawler, and it extracts business names, addresses, phone numbers, websites...

Turn any website into data with ScrapeUp API, which handles browsers, proxy rotation, and CAPTCHAs so developers can easily scrape any webpages with a single API call.

Broken Link Scan is a web-based link checker and site crawler. Enter any URL and it will crawl up to 500 pages for free, verifying every link, image, media resource, redirect chain and SSL certificate. Results are quick, with a health-score dashboard and an internal-vs-external...

SeekStorm - Search as a Service: high-performance search API provides full-text, real-time, instant search & crawling.

The world's most powerful search. Business-grade search and crawling for any web data.

ACHE is a web crawler for domain-specific search.

MediaPocket is an applications that can help you to download photos, videos and even entire pages from your favorite blogs in an instant. All you have to do is type a suitable blog address in the designated field and click the "Play" button available in the main...

Looksy is an advanced web scraper that uses smart search tools, recursive URL discovery, multithreading, human behaviour emulation, and intelligent filename guessing to efficiently find and download images and other files.

MainREST - web scrapping platform (framework) with API access.

Cockroach Crawler is a governed web acquisition and extraction layer for AI agents. It supports bounded public-web crawling, searchable site maps, robots handling, JavaScript rendering, readable text and Markdown, JSON and JSONL, structured fields, CSS, XPath, restricted-regex...

Automated website health monitoring — broken links, SEO, accessibility, performance and security checks on a schedule, with email, webhook, CSV and PDF reports.

FandangoSEO is an SEO Cloud tool that consists of a Crawler, a Log Monitoring, and a Competitive Analysis Tool. It provides valuable reports to master SEO strategies, improve the crawl budget, and increase the mobile and desktop traffic.

Cloudtrellis scans your entire site for broken links, accessibility issues, and SEO improvements to ensure a flawless user experience.

Collect news articles easily from any sources in any language. API, MySQL, ElasticSearch integration.

Analyzes any public site for agent and LLM accessibility, scores agent-readability 0–100, explains each issue in plain English, and gives fixes for compliance.

Best Rotating Proxy & Scraping API Alternative

You don't need to spend hours to create your own IP rotation rules and pay for different services. Just use scrape.do and only pay for successful requests. It's very easy and fast!.

Inout Scripts is a leading software development company that focuses primarily on clone scripts, Mobile Apps and e-business solutions. We have 21 scripts & 6 Mobile apps that are primarily used by small and medium ebusinesses in over 125...