Free tool · no signup
Which AI crawlers hit your site?
Paste a piece of your access log or drop the file. You get the AI crawlers it contains, how many requests and bytes each took, and rules to block them on your stack.
Your log stays in this browser: it is read here, and nothing is uploaded, stored or sent anywhere.
What the log shows
| Crawler | Operator | Use | Requests | Bytes | Share |
|---|
Crawlers are named by the user agent each request announced. A user agent can be forged, so a match says what the request claimed to be. Google-Extended and Applebot-Extended never appear in logs; they exist only as robots.txt controls.
Rules to block them
Want it done for you? We apply the rules to your site and check they work, for 350 USD. Check whether your site qualifies.