Octocrawl icon
Octocrawl icon

Octocrawl

Octocrawl turns public web pages into readable Markdown, tables and JSON for AI agents, RAG pipelines and research. Every page carries an Evidence Record: the final URL, HTTP status, robots.txt decision and hashes of what was read.

The Octocrawl home page: paste a public URL and get the page as Markdown with its Evidence Record.

Cost / License

Platforms

  • Online
  • Self-Hosted  Requires Node.js 22.13 or later (npx octocrawl serve)
  • Mac
  • Windows
  • Linux
Octocrawl alternatives  
0likes
1alternative
0articles
Save

Features

  1.  Ad-free
  2.  Support for MarkDown
  3.  AI Agents friendly
  4.  Model Context Protocol (MCP) Support

 Tags

Octocrawl News & Activities

Highlights All activities

Recent activities

Octocrawl information

AlternativeTo Categories

Development, AI Tools & Services

GitHub repository

  •  0 Stars
  •  0 Forks
  •  7 Open Issues
  •   Updated  
View on GitHub

Popular alternatives

View all
Octocrawl was added to AlternativeTo by 77777R7 on and this page was last updated .

No comments or reviews, maybe you want to be first?

Official Links

AppStores & Other Links

What is Octocrawl?

Octocrawl turns public web pages into readable Markdown, tables and JSON for AI agents, RAG pipelines and research. Every page carries an Evidence Record: the final URL, HTTP status, robots.txt decision and hashes of what was read. A blocked, empty or wrong page comes back with the reason instead of invented content.

Use it from the command line (npx octocrawl), from TypeScript or Python, over REST, or as an MCP server for Claude Code, Cursor, OpenCode and Codex. Beyond single pages it maps a site's URLs, crawls and batches, and can watch a page for changes. The hosted API and MCP server need no account within a daily allowance; running it yourself has no limit.