What is Codex?
Codex is an AI coding agent by OpenAI that helps developers write, review, debug, and ship code. You can set up Agent Analytics to see when Codex visits your website.
Overview
| Operated By | OpenAI |
| Source | Official Website |
| Expected To Follow Robots.txt | Yes |
| Insights Last Updated | October 18, 2026 |
Do you operate this agent? Contact us to suggest an update.
Category
Expected Behavior
Codex typically makes several requests within seconds. A single developer leaves quiet gaps, while overlapping sessions can produce steady traffic. Activity comes in short, targeted sessions rather than broad site-wide crawls.
How To Block Codex With Robots.txt
Add this rule to your robots.txt file to block Codex from accessing your website, or use Automatic Robots.txt to block all AI coding agents at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: Codex # https://knownagents.com/agents/codex
Disallow: /Insights for Codex
As of October 18, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Frequently Asked Questions
Should I Block Codex?
Allow Codex if developers rely on your documentation or technical content. Blocking it can make your product harder to build with but does not affect traditional search rankings. Almost none of the top websites we track currently have robots.txt rules for Codex.
Does Codex Follow Robots.txt Rules?
Yes. Codex is expected to follow robots.txt rules, so a disallow rule is the appropriate first step. Automatic Robots.txt can add and maintain that rule, while Agent Analytics lets you verify whether Codex respects it.
Does Codex Access Private Content?
Not unless a developer explicitly provides credentials. Codex otherwise reads only public documentation, references, and code examples.
How Can I Tell if Codex Is Visiting My Website?
Agent Analytics tracks Codex visits in real time. You can also check your server logs for requests whose user-agent string contains "Codex". Look for clustered requests across documentation, API reference, and code example pages. Because Codex does not publish a verification method, any client can claim its identity and a log match is only a clue.
Why Is Codex Visiting My Website?
A developer is working with a product or technology you document. Codex retrieved your documentation, API reference, or examples because they were relevant to the code being written.