← AI crawler directory
AI answer
Nostimates canary
NostimatesHonours robots.txt
We collect AI answers from the engines themselves. We do not crawl customer or third-party websites. Listed here because people ask. Our collection targets engine responses, never your origin server.
User-agent string
(none — we do not crawl your site)
How to verify it
Not applicable.
What blocking costs
Listed here because people ask. Our collection targets engine responses, never your origin server.
robots.txt rule
# Block Nostimates canary
User-agent: (nothing to block)
Disallow: /
# Allow everything else
User-agent: *
Allow: /Robots.txt is enough
Nostimates documents Nostimates canary as honouring robots.txt. Verify with your logs after deploying — a spoofed agent will keep coming.
Generate a full robots.txt
Pick which AI crawlers to allow or block across all 42 agents and copy the file out.
Open the generator →