Applebot-Extended
AI training crawlerLike Google-Extended, this is a robots.txt control rather than a separate crawler: it tells Apple not to use content already fetched by Applebot for training Apple's foundation models.
| Operator | Apple |
| Type | AI training crawler |
| Respects robots.txt | Yes (documented) |
| Documentation | Official operator documentation |
No user-agent of its own
Applebot-Extended is a robots.txt control token, not a separate crawler: you will never see it in your server logs. It changes how content fetched by Apple's regular crawlers may be used.
How to block Applebot-Extended in robots.txt
Add this to the robots.txt file at the root of your site:
Block Applebot-Extended
User-agent: Applebot-Extended
Disallow: /Explicitly allow Applebot-Extended
User-agent: Applebot-Extended
Allow: /What blocking changes: Your content is excluded from Apple Intelligence model training while remaining in Siri and Spotlight search.
Want to decide for all AI bots at once? Use the AI robots.txt generator.
Other ai training crawlers
- GPTBot (OpenAI)
- ClaudeBot (Anthropic)
- Google-Extended (Google)
- Meta-ExternalAgent (Meta)
- Bytespider (ByteDance)
- CCBot (Common Crawl)
Is AI sending you visitors?
Glyphex classifies AI referral traffic from ChatGPT, Perplexity, Claude, Gemini and more. See which assistants cite your pages and what those visitors do.
See your AI traffic