Known Agents
Products
Agent Analytics
AI Chat Referral Tracking
Automatic Robots.txt
Bad Bot Blocking
Agent Readiness and Optimization
Agent Identification
Getting Started
Resources
Agent Directory
The Agentic Web Index
Free Tools
AI Bot Robots.txt Checker
Pricing
Sign In
Sign Up
Menu
Products
Agent Analytics
AI Chat Referral Tracking
Automatic Robots.txt
Bad Bot Blocking
Agent Readiness and Optimization
Agent Identification
Getting Started
Resources
Agent Directory
The Agentic Web Index
Free Tools
AI Bot Robots.txt Checker
Pricing
Sign In
Sign Up
River
Overview
Website
https://river.ai/
Agents
AI Data Scrapers
RiverBot
RiverBot is River's web crawler that fetches publicly available web pages to train and evaluate River's AI models.
AI Data Scraper
AI Data Scraper
Downloads website content to include in datasets used for training AI models such as LLMs
See More →