A free GeoSuite tool
AI Crawl CheckWhich AI crawlers can read your site?
Paste a URL: we read its robots.txt and score it against every known AI bot, from GPTBot and ClaudeBot to PerplexityBot and Google-Extended.
- Free
- No sign-up
- Open source (MIT)
No login, no tracking. We fetch only /robots.txt, nothing else.
The same check, from your terminal or CI
It is also a zero-dependency CLI on npm, and a GitHub Action that fails the build when a robots.txt change shuts an AI crawler out.
npx @geosuite/ai-crawler-bots robots <url>Readable is step one. Recommended is the goal.
Letting AI crawlers in means they can read you, not that they will suggest you. GeoSuite asks ChatGPT, Gemini and Perplexity the questions your customers really ask, and tells you where you appear, who wins instead and what to fix first. The report arrives by email.