What is PageSourceSearchBot?
PageSourceSearchBot crawls public pages and first-party JavaScript to build PageSourceSearch's searchable index of website source code. You can set up Agent Analytics to see when PageSourceSearchBot visits your website.
Overview
| Operated By | PageSourceSearch |
| Source | Official Website |
| Expected To Follow Robots.txt | Yes |
| Insights Last Updated | October 21, 2026 |
Do you operate this agent? Contact us to suggest an update.
Category
Expected Behavior
PageSourceSearchBot follows an algorithmic schedule shaped by your site's popularity, update cadence, and domain authority. It generally spreads requests across recurring crawl passes, throttles itself to limit server load, and respects crawl rules more reliably than most other bots.
How To Block PageSourceSearchBot With Robots.txt
Add this rule to your robots.txt file to block PageSourceSearchBot from accessing your website, or use Automatic Robots.txt to block all search engine crawlers at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: PageSourceSearchBot # https://knownagents.com/agents/pagesourcesearchbot
Disallow: /Insights for PageSourceSearchBot
As of October 21, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Frequently Asked Questions
Should I Block PageSourceSearchBot?
No, unless you want to remove your pages from that search engine. PageSourceSearchBot supplies its index, so blocking it can eliminate your visibility and organic traffic there. Nearly every website should allow this category. Almost none of the top websites we track currently have robots.txt rules for PageSourceSearchBot.
Does PageSourceSearchBot Follow Robots.txt Rules?
Yes. PageSourceSearchBot is expected to follow robots.txt rules, so a disallow rule is the appropriate first step. Automatic Robots.txt can add and maintain that rule, while Agent Analytics lets you verify whether PageSourceSearchBot respects it.
Does PageSourceSearchBot Access Private Content?
No special access. PageSourceSearchBot can reach only content available to anonymous visitors and does not sign in. Make sure sensitive content is not public by mistake.
How Can I Tell if PageSourceSearchBot Is Visiting My Website?
Agent Analytics tracks PageSourceSearchBot visits in real time. You can also check your server logs for requests whose user-agent string contains "PageSourceSearchBot". Look for recurring passes that revisit changed pages and discover new ones. Because PageSourceSearchBot does not publish a verification method, any client can claim its identity and a log match is only a clue.
Why Is PageSourceSearchBot Visiting My Website?
PageSourceSearchBot is adding new or changed pages to its search index. It may have discovered your site through links, a sitemap, or direct submission.