What is HeadlessChrome?
Headless Chrome is a tool provided by Google's open source Chromium project that gives software the ability to render web pages in full detail. One of the most common use cases is enabling AI agents to browse the internet through libraries like Playwright and Puppeteer. Agent Analytics can track when it visits your website.
Overview
| Source | Official Website |
| Expected To Follow Robots.txt | No |
| Insights Last Updated | August 1, 2026 |
Do you operate this agent? Contact us to suggest an update.
Category
Expected Behavior
HeadlessChrome is generic automation, so its pattern is whatever script or AI is driving it. Human guided runs look like short deliberate sessions, while autonomous runs look like a browser that never gets tired. Judge it by request timing and paths, which reveal more than its name does.
HeadlessChrome's User Agent
| User Agent | Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/145.0.0.0 Safari/537.36 |
How To Block HeadlessChrome With Robots.txt
Add this rule to your robots.txt file to request that HeadlessChrome not access your website, or use Automatic Robots.txt to request the same of all automated agents at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: HeadlessChrome # https://knownagents.com/agents/headlesschrome
Disallow: /Global Insights for HeadlessChrome
As of August 1, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the world's top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Robots.txt Blocking Trend
0% of top websites block HeadlessChrome in their robots.txt files.
Overall Automated Agent Traffic
0.2% of all web traffic came from automated agents.
Top Visited Website Categories
The types of websites most frequently visited by HeadlessChrome.
Frequently Asked Questions
Should I Block HeadlessChrome?
Judge it by its behavior. Agents in this category range from harmless testing tools to abusive automation, and HeadlessChrome's purpose depends on whoever is running it. Block it if it hits login pages, submits forms, or crawls faster than any human could. Almost none of the top websites we track have robots.txt rules for HeadlessChrome right now.
Does HeadlessChrome Follow Robots.txt Rules?
No. HeadlessChrome is not expected to follow robots.txt rules, so a disallow rule only states your preference. Enforce the block with firewall or server rules, then confirm in Agent Analytics that its requests actually stop.
Does HeadlessChrome Access Private Content?
It accesses whatever it is scripted to access. If someone gives HeadlessChrome credentials, it can do anything that account can do. Without them, it is limited to public pages.
Why Is HeadlessChrome Visiting My Website?
Someone automated a task that involves your site. HeadlessChrome could be running tests, collecting data, or following an AI system's instructions, and its visit pattern tells you more than its user agent string does.
How Can I Tell if HeadlessChrome Is Visiting My Website?
Agent Analytics tracks HeadlessChrome visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user agent string contains "HeadlessChrome". Look for regular timing and repeated paths that no human browsing would produce. Keep in mind that HeadlessChrome doesn't publish a verification method, so any client can claim its user agent string and a log match is a hint rather than proof.