SiteOne Crawler icon
SiteOne Crawler icon

SiteOne Crawler

 16 likes

A free in-depth website analyzer providing audits of security, performance, SEO, accessibility and other technical aspects. Available as a desktop application for Windows/macOS/Linux and as a CLI tool for advanced users and CI/CD processes. It also includes an offline web page exporter.

A collage showing the graphical interface and crawler output

License model

  • Free • Open Source

Application types

Country of Origin

  • CZ flagCzechia
  • European Union flagEU

Platforms

  • Mac
  • Windows
  • Linux
Crawling process shows the ongoing output of a website crawl, listing URLs being processed, their status codes (e.g., 200, 302), content type (e.g., HTML, CSS, Image), response times, and sizes. It provides a real-time view of how the crawler is fetching resources, highlighting successful loads, redirects, and any issues encountered.
Basic crawler settings includes options to adjust performance limits such as timeout, concurrent workers, and max requests per second. Content settings allow/block JavaScript, CSS, fonts, images, and files. The crawler can cache requests, store data in memory or on disk. Additionally, it provides options for generating reports, with the ability to upload an HTML report and set a retention period.
+9
Advanced settings allows fine-tuning of a web crawler, including device type, user agent, timeout, and max requests. It offers output customization, resource filtering, regex-based URL handling, and export options for HTML, JSON, and text reports. Additional features include debug modes, sitemap generation, SEO analysis, email notifications, and storage compression.
Alternatives  
5 / 5 Avg rating (4)
16likes
3comments
26alternatives
0news articles

Features

Suggest and vote on features
  1.  Website Downloader
  2.  Performance analysis
  3.  Website Audit
  4.  Graphical User Interface
  5.  Save web page for offline use
  6.  Daily Website Analysis
  7.  Ad-free
  8.  Command line interface
  9.  No Coding Required
  10.  Dark Mode
  11.  Multiplatform
  12.  Accessibility Testing
  13.  Security Testing
  14.  Electron based
  15.  SEO Audit
  16.  Miror website locally
  17.  Crawler
  18.  CI/CD

 Tags

SiteOne Crawler News & Activities

Highlights All activities

Recent activities

Show all activities

SiteOne Crawler information

  • Developed by

    CZ flagJan Reges (SiteOne, s.r.o.)

  • Licensing

    Open Source (MIT) and Free product.

  • Written in

  • Rating

    Average rating of 5

  • Alternatives

    26 alternatives listed

  • Supported Languages

    • English

AlternativeTo Categories

Development, OS & Utilities, Business & Commerce, Security & Privacy, Network & Admin

GitHub repository

  •  169 Stars
  •  13 Forks
  •  7 Open Issues
  •   Updated Jun 9, 2025 
View on GitHub

Popular alternatives

View all

Our users have written 3 comments and reviews about SiteOne Crawler, and it has gotten 16 likes

SiteOne Crawler was added to AlternativeTo by janreges on Aug 17, 2024 and this page was last updated Aug 19, 2024.

Comments and Reviews

   
 Post comment/review
Top Positive Comment
thinkpro
★
★
★
★
★
Sep 26, 2024
1

I use the command line tool more, which has a lot of options and I like the speed and very clear and colorful output. The audit report is great too.

Mike
★
★
★
★
★
Dec 18, 2024
0

It is the fastest crawler I know. The range of functions and configurability is very high. If it is actively developed further over the next few years, it could one day replace Screaming Frog SEO Spider and Website Crawler as the market leader.

janreges
★
★
★
★
★
Aug 19, 2024
1

This free website analyzer is a very versatile helper that finds various problems or reserves on the website in the area of ​​performance, security, SEO, accessibility or best-practices.

It analyzes, for example, such details as whether a phone number is left in the web content, but it is not an active link with the option to make a phone call immediately.

What is SiteOne Crawler?

This free multi-platform desktop application (with the possibility to use the command line interface) provides in-depth website analysis (security, performance, SEO, accessibility).

The aim is to use a single tool to perform a comprehensive analysis of all relevant areas and help detect problems that are not visible at first glance. The main output is a clearly structured HTML report that can be easily shared with colleagues. You can easily upload the output report to the our cloud and limit the lifetime of the report and its URL from 1 hour to infinity. Text output and JSON output is also available for further processing.

The tool is designed for ease of use, with simple installation and a user-friendly interface. An important and useful functionality is the possibility to export the entire website to an offline form, where it can run even without a web server, from the computer's local disk. Including styles, fonts, images and documents.

The ambition of the authors of this tool is to create a free tool that will help developers, testers and owners to improve the quality of websites around the world. We would therefore be happy to receive your feedback in the comments and suggestions for possible improvements. Thanks!

SiteOne Crawler Videos

Show 2 more videos

Official Links

AppStores & Other Links

Social Networks