AI bots · Search
PerplexityBot
Surfaces and links websites in Perplexity search results. Perplexity says it is not used to crawl content for AI foundation models.
- Run by
- Perplexity
- Type
- Search bot
- robots.txt token
PerplexityBot- User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)- Honours robots.txt
- Yes. Perplexity recommends allowing it in robots.txt to appear in results.
- Official docs
- docs.perplexity.ai
- Published IP list
- www.perplexity.com/perplexitybot.json
Block it
User-agent: PerplexityBot Disallow: /
Allow it
User-agent: PerplexityBot Allow: /
A named group replaces the * group for this bot, so repeat any private-path Disallow lines in it. Firewalls (Cloudflare AI Crawl Control, Vercel AI Bots ruleset) can block it even when robots.txt allows it. See fixes per stack.
Other Perplexity bots
- Perplexity-User (user fetch)
Other search bots
- OAI-SearchBot (OpenAI)
- Claude-SearchBot (Anthropic)
- Applebot (Apple)
- Amzn-SearchBot (Amazon)
- MistralAI-Index (Mistral AI)
- DuckAssistBot (DuckDuckGo)
- Meta-WebIndexer (Meta)