School · Module 5 · Lesson 2 of 3
Training bots vs search and user-fetch bots
Blocking GPTBot is not the same as blocking OAI-SearchBot.
Training bots (GPTBot, ClaudeBot, Google-Extended, Applebot-Extended and others) collect content that may be used to train models. Search and user-fetch bots retrieve pages so assistants can cite or show them.
Many sites allow search and user-fetch, and choose separately whether to allow training. Check each vendor's docs; tokens and policy pages change.
Applebot uses your Googlebot rules for some behaviour; see the bot page for the current note.