Cockroach Crawler
Like
Cockroach Crawler is a governed web acquisition and extraction layer for AI agents. It supports bounded public-web crawling, searchable site maps, robots handling, JavaScript rendering, readable text and Markdown, JSON and JSONL, structured fields, CSS, XPath, restricted-regex...
Features
No features, maybe you want to suggest one?
Cockroach Crawler News & Activities
Highlights All activities
Recent activities
selenowitz added Cockroach Crawler as alternative to SocialCrawl
ducnhatvo added Cockroach Crawler as alternative to FoxPull
AbrahamEsther added Cockroach Crawler as alternative to Scrapy
AbrahamEsther added Cockroach Crawler as alternative to Apify- AbrahamEsther added Cockroach Crawler as alternative to Crawl4AI
- AbrahamEsther added Cockroach Crawler
AbrahamEsther added Cockroach Crawler as alternative to Firecrawl and Anakin.io
Cockroach Crawler information
Developed by
Ajnas N BLicensing
Open Source (MIT) and Free product.Written in
Alternatives
7 alternatives listedSupported Languages
- English
AlternativeTo Category
DevelopmentGitHub repository
- 5 Stars
- 2 Forks
- 18 Open Issues
- Updated
No comments or reviews, maybe you want to be first?
What is Cockroach Crawler?
Cockroach Crawler is a governed web acquisition and extraction layer for AI agents. It supports bounded public-web crawling, searchable site maps, robots handling, JavaScript rendering, readable text and Markdown, JSON and JSONL, structured fields, CSS, XPath, restricted-regex selectors, MCP, CLI, serverless, and browser handoff workflows. npm latest is 0.6.1; 0.7.0-rc.1 is available under the next tag. It is open source under the MIT license.