Free, no signup

Can AI crawlers reach your site?

Check robots.txt, Cloudflare managed rules, llms.txt, and live edge behavior in one fast scan.

We only make public requests. Your URL is not stored.

A clearer signal

Four checks. One useful answer.

We resolve the rules for citation and training crawlers separately.

Managed injection markers and AI disallow blocks get their own warning.

We check availability, content type, and the structure of both files.

A browser/GPTBot mismatch can reveal a block robots.txt misses.

Does this change my robots.txt?+

No. AI Crawl Check only fetches public endpoints and reports what it sees.

What does Mixed mean?+

Mixed means at least one crawler is partially or implicitly governed, or the live GPTBot probe differs from a normal browser.

Does a robots Allow guarantee citation?+

No. Robots rules are one input. Provider policies, WAF rules, authentication, and content quality also matter.