Known Agents
Products
Agent Analytics
LLM Referral Tracking
Automatic Robots.txt
Agent Identification API
Docs
Send Visit Events
Set Up Automatic Robots.txt
Use the Agent Identification API
Free Tools
AI Bot Robots.txt Checker
Agent Directory
Global Insights
Pricing
Sign In
Sign Up
Menu
Products
Agent Analytics
LLM Referral Tracking
Automatic Robots.txt
Agent Identification API
Docs
Send Visit Events
Set Up Automatic Robots.txt
Use the Agent Identification API
Free Tools
AI Bot Robots.txt Checker
Agent Directory
Global Insights
Pricing
Sign In
Sign Up
Arquivo
Agents & Bots
Archivers
Arquivo-web-crawler
Arquivo-web-crawler is the Portuguese web archive's bot that systematically crawls and preserves Portuguese websites for historical research, creating a comprehensive dig…
Archiver
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →