What is PerplexityBot?
PerplexityBot is the web crawler for Perplexity AI that indexes web content to power the AI search engine's real-time information retrieval and answer generation capabilities, enabling conversational search experiences. Agent Analytics can track when it visits your website.
Overview
| Operated By | Perplexity |
| Source | Official Website |
| Expected To Follow Robots.txt | Yes |
| Insights Last Updated | July 12, 2026 |
Category
Expected Behavior
PerplexityBot works like Googlebot with a less predictable calendar. Expect recurring crawls across your whole site, at a frequency that tracks how often your content changes and how much authority your site carries. Visits can cluster in bursts when its index refreshes.
PerplexityBot's User Agent
| User Agent | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) |
How To Block PerplexityBot With Robots.txt
Add this rule to your robots.txt file to block PerplexityBot from accessing your entire website, or use Automatic Robots.txt to block all AI search crawlers at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: PerplexityBot # https://knownagents.com/agents/perplexitybot
Disallow: /Global Insights for PerplexityBot
As of July 12, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the world's top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Robots.txt Blocking Trend
15% of top websites block PerplexityBot in their robots.txt files.
Overall AI Search Crawler Traffic
2.6% of all web traffic came from AI search crawlers.
Top Visited Website Categories
The types of websites most frequently visited by PerplexityBot.
Frequently Asked Questions
Should I Block PerplexityBot?
No, for the same reason you would not block Googlebot. PerplexityBot indexes your site for an AI search engine, and its results link back to you. Blocking it removes you from a whole search channel without helping your traditional rankings. For comparison, 15% of the top websites we track already have robots.txt rules for PerplexityBot.
Does PerplexityBot Follow Robots.txt Rules?
Yes. PerplexityBot is expected to follow robots.txt rules, so a disallow rule is the right first move. Automatic Robots.txt adds and maintains that rule for you, and Agent Analytics confirms PerplexityBot actually follows it.
Does PerplexityBot Access Private Content?
No. PerplexityBot indexes what an anonymous visitor can load, like a traditional search crawler. The bigger risk is content that is public by accident, like a staging site, which it will happily index.
Why Is PerplexityBot Visiting My Website?
PerplexityBot is indexing your site so your pages can appear in its AI search results. It found you through links, your sitemap, or mentions of your domain, and it returns on its own schedule to keep the index fresh.
How Can I Tell if PerplexityBot Is Visiting My Website?
Agent Analytics tracks PerplexityBot visits and every other known AI agent, crawler, and scraper alongside it, then authenticates each visit against PerplexityBot's published verification method. You can also check your server logs for requests whose user agent string contains "PerplexityBot". Look for recurring visits spread across your site, like a search engine crawl. A log match is still not proof, because any bot can claim to be PerplexityBot.