Known Agents
Products
Agent Analytics
AI Chat Referral Tracking
Automatic Robots.txt
Agent Identification API
Setup Guides
Send Visit Events
Set Up Automatic Robots.txt
Block Bad Bots
Use the Agent Identification API
Resources
Agent Directory
The Agentic Web Index
Free Tools
AI Bot Robots.txt Checker
Pricing
Sign In
Sign Up
Menu
Products
Agent Analytics
AI Chat Referral Tracking
Automatic Robots.txt
Agent Identification API
Setup Guides
Send Visit Events
Set Up Automatic Robots.txt
Block Bad Bots
Use the Agent Identification API
Resources
Agent Directory
The Agentic Web Index
Free Tools
AI Bot Robots.txt Checker
Pricing
Sign In
Sign Up
01.AI
Overview
Website
https://01.ai/
Agents
AI Data Scrapers
YiBot
YiBot crawls public web content for 01.AI, the company behind the Yi family of foundation models and enterprise AI products.
AI Data Scraper
AI Data Scraper
Downloads website content to include in datasets used for training AI models such as LLMs
See More →