AIToolMapsBot

AIToolMapsBot is the crawler behind AIToolMaps. It identifies itself as AIToolMapsBot/1.0 (+https://aitoolmaps.com/bot).

What it reads

When an AI product is listed or about to be, the bot reads that product's own home page and, where they exist, its pricing, features and documentation pages, plus the site's icon and a screenshot of the home page. We use them to write the listing in our own words and to check its facts. Listed products are read again about once a week.

How politely

• It obeys robots.txt, including rules addressed to AIToolMapsBot.
• It makes at most one request every five seconds to a site, and reads at most 2 MB of a page.
• It does not log in, submit forms or run your product.

How to stop it

Add this to your robots.txt:

User-agent: AIToolMapsBot
Disallow: /