What is GoogleAgent-URLContext?
GoogleAgent-URLContext is a web fetcher operated by Google that retrieves web content on behalf of Gemini API users. When a developer provides a URL as context in a Gemini API request, this bot fetches the page so the AI model can analyze and incorporate it into its response. Agent Analytics can track when it visits your website.
Overview
| Operated By | |
| Expected To Follow Robots.txt | Yes |
| Insights Last Updated | July 12, 2026 |
Category
Expected Behavior
GoogleAgent-URLContext fetches one page at a time, the moment someone asks a question it can answer, so it never crawls your site. How much you see depends on how many people use GoogleAgent-URLContext and how often they ask about what your site covers. A popular assistant can hit you steadily, while a single user or a niche one stays quiet between occasional spikes.
GoogleAgent-URLContext's User Agent
| User Agent | GoogleAgent-URLContext |
How To Block GoogleAgent-URLContext With Robots.txt
Add this rule to your robots.txt file to block GoogleAgent-URLContext from accessing your entire website, or use Automatic Robots.txt to block all AI assistants at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: GoogleAgent-URLContext # https://knownagents.com/agents/googleagent-urlcontext
Disallow: /Global Insights for GoogleAgent-URLContext
As of July 12, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the world's top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Robots.txt Blocking Trend
0% of top websites block GoogleAgent-URLContext in their robots.txt files.
Overall AI Assistant Traffic
1.5% of all web traffic came from AI assistants.
Top Visited Website Categories
The types of websites most frequently visited by GoogleAgent-URLContext.
Frequently Asked Questions
Should I Block GoogleAgent-URLContext?
Probably not. GoogleAgent-URLContext fetches a page when someone asks a question it can answer, and the response cites and links to your site. Blocking it removes you from those answers without improving your Google rankings, because assistants play no part in traditional search indexing. Almost none of the top websites we track have robots.txt rules for GoogleAgent-URLContext right now.
Does GoogleAgent-URLContext Follow Robots.txt Rules?
Yes. GoogleAgent-URLContext is expected to follow robots.txt rules, so a disallow rule is the right first move. Automatic Robots.txt adds and maintains that rule for you, and Agent Analytics confirms GoogleAgent-URLContext actually follows it.
Does GoogleAgent-URLContext Access Private Content?
It has no way in. GoogleAgent-URLContext fetches pages the way an anonymous visitor loads a URL, with no stored logins. Anything behind a paywall or a login stays out of its reach.
Why Is GoogleAgent-URLContext Visiting My Website?
Someone asked Google's assistant a question your page can help answer. GoogleAgent-URLContext retrieved the page in that moment to ground the answer, usually with a citation linking back to you.
How Can I Tell if GoogleAgent-URLContext Is Visiting My Website?
Agent Analytics tracks GoogleAgent-URLContext visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user agent string contains "GoogleAgent-URLContext". Look for fetches of individual pages that do not follow a crawl pattern. Keep in mind that GoogleAgent-URLContext doesn't publish a verification method, so any client can claim its user agent string and a log match is a hint rather than proof.