AI bots · User fetch
ChatGPT-User
Visits a page when a ChatGPT or Custom GPT user asks a question that needs it. Not used for automatic crawling or for deciding what appears in search.
- Run by
- OpenAI
- Type
- User fetch bot
- robots.txt token
ChatGPT-User- User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot- Honours robots.txt
- Partly. OpenAI says that because these actions are user-initiated, robots.txt rules may not apply.
- Official docs
- platform.openai.com
- Published IP list
- openai.com/chatgpt-user.json
Block it
User-agent: ChatGPT-User Disallow: /
Allow it
User-agent: ChatGPT-User Allow: /
A named group replaces the * group for this bot, so repeat any private-path Disallow lines in it. Firewalls (Cloudflare AI Crawl Control, Vercel AI Bots ruleset) can block it even when robots.txt allows it. See fixes per stack.
Other OpenAI bots
- GPTBot (training)
- OAI-SearchBot (search)
Other user fetch bots
- Claude-User (Anthropic)
- Perplexity-User (Perplexity)
- Meta-ExternalFetcher (Meta)
- Amzn-User (Amazon)
- MistralAI-User (Mistral AI)