← AI crawler directory
AI training
Applebot-Extended
AppleHonours robots.txt
Robots.txt token controlling whether Apple uses your content to train Apple Intelligence models. Opts you out of Apple Intelligence training while keeping Siri and Spotlight indexing intact.
User-agent string
(control token only)
How to verify it
Not applicable — directive only.
What blocking costs
Opts you out of Apple Intelligence training while keeping Siri and Spotlight indexing intact.
robots.txt rule
# Block Applebot-Extended
User-agent: Applebot-Extended
Disallow: /
# Allow everything else
User-agent: *
Allow: /Robots.txt is enough
Apple documents Applebot-Extended as honouring robots.txt. Verify with your logs after deploying — a spoofed agent will keep coming.
Generate a full robots.txt
Pick which AI crawlers to allow or block across all 42 agents and copy the file out.
Open the generator →Other Apple agents