Apps tagged with 'AI Crawlers'

All apps in Apps tagged with 'AI Crawlers' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. QueryRev AI Readiness icon

    QueryRev AI Readiness

     Like

    QueryRev AI Readiness checks how a website's public files treat AI crawlers. It reports which of 11 AI crawlers (from OpenAI, Perplexity, Google, Apple, Common Crawl, Meta, Amazon and ByteDance) robots.txt lets in, whether the site's llms.txt is a real llms.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Node.JS
    • US flagUnited States
    QueryRev AI Readiness screenshot 1
    1 alternative