AI bots · Training
Applebot-Extended
Not a crawler. A robots.txt token that controls whether data crawled by Applebot is used to train Apple's foundation models.
- Run by
- Apple
- Type
- Training bot
- robots.txt token
Applebot-Extended- User-agent string
None. Apple says Applebot-Extended does not crawl webpages.- Honours robots.txt
- Yes, it exists only as a robots.txt token. Pages that disallow it can still appear in Apple search results.
- Official docs
- support.apple.com
Block it
User-agent: Applebot-Extended Disallow: /
Allow it
User-agent: Applebot-Extended Allow: /
A named group replaces the * group for this bot, so repeat any private-path Disallow lines in it. Firewalls (Cloudflare AI Crawl Control, Vercel AI Bots ruleset) can block it even when robots.txt allows it. See fixes per stack.
Other Apple bots
- Applebot (search)
Other training bots
- GPTBot (OpenAI)
- ClaudeBot (Anthropic)
- Google-Extended (Google)
- CCBot (Common Crawl)
- Meta-ExternalAgent (Meta)
- Amazonbot (Amazon)
- MistralAI-Training (Mistral AI)
- Bytespider (ByteDance)