Known Agents
Products
Agent Analytics
AI Chat Referral Tracking
Automatic Robots.txt
Agent Identification
Getting Started
Resources
Agent Directory
The Agentic Web Index
Free Tools
AI Bot Robots.txt Checker
Pricing
Sign In
Sign Up
Menu
Products
Agent Analytics
AI Chat Referral Tracking
Automatic Robots.txt
Agent Identification
Getting Started
Resources
Agent Directory
The Agentic Web Index
Free Tools
AI Bot Robots.txt Checker
Pricing
Sign In
Sign Up
Sur.ly
Overview
Website
https://sur.ly/
Agents
Fetchers
SurdotlyBot
SurdotlyBot is the web crawler for Sur.ly, a content preview and link shortening service. This bot fetches content to generate previews and thumbnails for links shared th…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →