Publishers FAQ
What does Known Agents do?
- Shows you which bots are visiting your pages, in real time (Agent Analytics)
- Measures citations and human referrals from AI chat platforms (LLM Referral Tracking)
- Automatically adds robots.txt rules for entire categories of bots (Automatic Robots.txt)
- Detects "bad bots" making unidentified, spoofed, or disallowed visits, and blocks them with your WAF (Bad Bot Detection)
- Etc.
How does this help us?
- Get full visibility into the ~40% of your traffic that comes from bots
- Protect your content from unauthorized AI training, using your existing tools
- Save time researching new bots and editing your robots.txt, and avoid costly mistakes
- Cut server costs from low value bot traffic
- Document crawling to build data-driven leverage for content licensing deals
- Build a new readership channel as AI chat becomes a primary distributor
- Double down on the stories that AI platforms are amplifying
How does Known Agents compare to other tools?
| Other Tools | Known Agents |
|---|---|
| Only track a subset of bots | Tracks ~3,000 bots (every known bot on the internet, not just AI) |
| No human LLM referral tracking | Track humans coming from ChatGPT, Claude, Gemini, etc. |
| High level dashboards | Granular breakdowns per bot, category, page, LLM referrer, etc. |
| Low data retention | High data retention (2 years), report exporting |
| Difficult to set up (subdomains, DNS, etc.) | 5 minute setup, copy and paste, works with your existing platform |
| Complex contracts | Self-serve, simple and affordable pricing |
In fact, Known Agents works well alongside other tools, like monetization platforms or your existing CDN firewall.
How do we connect our website?
- No complex engineering, new subdomains, or DNS changes
- Use the WordPress plugin, your CDN (Cloudflare, Fastly, AWS, etc.), or our API
- 5 minute setup for anyone (not just engineers), a simple copy and paste
- Start seeing realtime data immediately
How much does Known Agents cost?
- The vast majority of our users are on the Free Plan
- We offer off-the-shelf plans for medium publishers, and usage-based Enterprise Plans for large publishers
How can we see a demo?
Please request a demo or contact us. You can also sign up and connect your website on your own. No need to wait for us.
Screenshots
