Test every AI crawler and see who is locked out
We request your site from the outside with real user agents and record the response each AI crawler actually gets. The result is a table you can screenshot and reproduce yourself.
What the access test does
Make sure AI can read you before worrying about how well you write.
Every AI crawler, tested on its own
Requests go out with each operator's published user agent; we record the status code and what came back. TBD-number of user agents and test frequency.
why it matters
People really do ask about this
real questions
60,397
TBD-data source name · Sep 2026
from Reddit
88.8%
TBD-data source name · Sep 2026
about crawler access
1,669
TBD-data source name · Sep 2026
Start by looking at your own access table
TBD-closing copy.
About the access test
Will the test put load on my site?
TBD-answer (to be written once the real request volume and frequency are confirmed).
Which AI crawlers do you test?
TBD-answer: list the user agents and operators, with the date the list was last updated.
Can I reproduce the results myself?
Yes. Every row records the user agent and time of the request, so you can send the same request and check.
robots.txt already allows them — why am I still blocked?
robots.txt is only a declaration. The response is decided by the CDN, WAF or firewall rules in front of your server, which can block by user agent or IP on their own.