Apps with 'Scheduled Data Crawling' feature
The Screaming Frog SEO Spider is a small desktop program (PC or Mac) which crawls websites’ links, images, CSS, script and apps from an SEO perspective.
Ambar is a smart documents archive with automated crawling, OCR, deduplication and ultra-fast full-text search.
Pulse offers an intuitive website audit solution with all the time-saving tools you need to grow your business. Our crawler allows for automation of all aspects of site crawling, leaving you more time to focus on the big picture.
SiteAnalyzer is a Web Crawler to scan the websites and check their technical and of SEO-parameters for errors and correct them effectively.
Oxylabs is a tech company providing tools and resources for web data harvesting. Premium dedicated Proxies designed for high-scope data mining.