Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Fetchers
-
BloglinesBloglines is an RSS feed reader and aggregation service operated by Ask Media Group that fetches and parses syndicated content from blogs and websites to display updates …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
BlogtrottrBlogtrottr is the RSS feed crawler that fetches content from blogs, news feeds, and websites to deliver updates directly to users' email inboxes, providing automated cont…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
BlueskyBluesky social network's link preview bot pre-fetches URLs to generate webpage previews for posts, enabling rich content display in the decentralized social media platfor…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Bluesky Link Preview ServiceBluesky Link Preview Service is a fetcher operated by Bluesky.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
BoardGamePrices BotBoardGamePrices Bot crawls board game retailers to compare prices across 930,622+ games from 284 stores worldwide. It tracks pricing data, stock status, and price drops t…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
BubblesBotBubblesBot is the web crawler for Bubbles, a community-driven platform that aggregates and ranks blog posts from independent, personal blogs based on user votes and fresh…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
BublupBotBublupBot is a web crawler operated by Bublup, a content organization and bookmarking platform. This bot fetches previews and metadata from bookmarked content to generate…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
BufferLinkPreviewBotBufferLinkPreviewBot is a web crawler operated by Buffer, a social media management platform, that generates rich link previews when users share links in their social med…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ButtondownButtondown is an automated RSS feed crawler that fetches content from blogs and websites to convert them into newsletter content, allowing users to turn their RSS feeds i…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Buttondown RSS-Feed-ParserButtondown RSS-Feed-Parser is a bot used by Buttondown, an email newsletter service, to fetch and parse RSS feeds for their RSS-to-email feature. This allows newsletter c…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
CapitalOneBotCapitalOneBot is a web crawler used by Capital One to crawl dealer websites and gather usage information for Capital One's lead navigator button integration. It monitors …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Citoidcitoid is Wikimedia's citation generation service that fetches metadata from URLs, DOIs, and ISBNs to automatically create formatted citations in Wikipedia and other wiki…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ClickUpLinkUnfurlerClickUpLinkUnfurler is a bot operated by ClickUp, a project management and productivity platform. It fetches webpage content to generate link previews when users paste UR…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
CollapsifyCollapsify is a Cloudflare internal service that crawls customer error pages to serve them directly from Cloudflare's edge network. This improves performance by caching a…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ContentStudioContentStudio is a web fetcher operated by ContentStudio that retrieves articles for content discovery, social-media publishing, and link previews.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ContentStudio-Feed-FetcherContentStudio-Feed-Fetcher is a web fetcher operated by ContentStudio that retrieves articles from configured feeds for content discovery and publishing workflows.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ConvermaxBotConvermaxBot is a fetcher.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Cozi-iCalendar-FeedReaderCozi-iCalendar-FeedReader periodically fetches external iCalendar feeds to synchronize them with users' Cozi family calendars, enabling automatic updates from school, wor…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
CurrentCurrent is an RSS reader application for iPhone, iPad, and Mac that fetches RSS feeds and articles from websites to deliver content to its users. The bot visits sites to …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
DiscordbotDiscordbot scrapes URLs shared in Discord chats to generate link previews, extracting titles, descriptions, and images to provide contextual content previews within the p…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
dlvr.itdlvr.it is a content delivery and social media automation service that fetches content from websites to automatically share and distribute it across various social media …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
easybill-ImportManagereasybill-ImportManager is an automated data synchronization tool that fetches order and customer information from external e-commerce systems, marketplaces, and business …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
EchoboxBotEchoboxBot is a crawler operated by Echobox, a social media automation platform designed for publishers that helps manage and optimize content distribution on social medi…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
EmbedlyEmbedly is a content embedding service that fetches and processes web content to generate rich media previews and embeds for websites and applications. When users share l…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
eMoneyBoteMoneyBot is a financial data crawler operated by eMoney Advisor that collects financial information from websites to support their comprehensive financial planning platf…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
EvernoteRichLinkBotEvernoteRichLinkBot is a web crawler operated by Evernote, a note-taking and productivity application, that fetches webpage content to generate rich link previews when us…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
facebookfacebook is a fetcher operated by Meta.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
facebookexternalhitfacebookexternalhit is Meta's web crawler that fetches content from apps or websites shared on Facebook, Instagram, or Messenger to gather, cache, and display information…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Fastmail BotFastmail Bot is a fetcher operated by Fastmail.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FastmailUAFastmailUA is Fastmail's content fetcher and image proxy service that retrieves external images and content for email security. It protects users from tracking pixels and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FaviconAPIFaviconAPI retrieves and caches website favicons for Vemetric's favicon API, which returns site icons to applications from a requested domain.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FedReporterDataBotFedReporterDataBot automatically downloads financial regulatory data from FFIEC sources including Active/Closed/Branches files, Holding Company data, and Call Report data…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedbinFeedbin is an RSS reader service that fetches and aggregates web content, RSS feeds, email newsletters, podcasts, and YouTube videos to provide users with a centralized r…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
feedbotfeedbot is a WordPress.com bot that fetches and delivers RSS feed content to subscribers. It retrieves updated feed content on behalf of WordPress.com users to deliver bl…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedBurnerFeedBurner is a web feed management service that fetches RSS and Atom feeds from websites to provide feed hosting, analytics, and distribution services. The bot retrieves…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeederFeeder is a fetcher operated by Really Simple.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
feeder.cofeeder.co is a cloud-based RSS feed reader that fetches content from over 3 million feed URLs for more than 500,000 users, providing news aggregation and filtering capabi…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedFlowFeedFlow is an RSS reader application that fetches and syncs RSS feed content across multiple devices. The bot visits websites to retrieve RSS feed updates for users who …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedlyFeedly is an RSS reader bot that fetches and aggregates content from blogs, news sites, and newsletters. It provides threat intelligence, market intelligence, and news re…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedopsBotFeedopsBot is a web fetcher operated by FeedOps that retrieves articles from configured RSS feeds for social-media content automation.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedspotFeedspot is an RSS feed fetcher that crawls websites to collect and aggregate content for its feed reader service. The bot retrieves blog posts and articles that users ha…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedwindFeedwind is Mikle's RSS feed aggregation bot that accesses feed sources every 5 minutes to 5 hours (depending on user plan) to keep feed widgets updated with the latest c…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FeedWind CrawlerFeedWind Crawler is a fetcher operated by Mikle.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FFZBotFFZBot is a web fetcher operated by FrankerFaceZ that retrieves content used by its Twitch enhancement services.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FlipboardProxyFlipboardProxy crawls and fetches content from publisher websites to format articles for display in the Flipboard social magazine app.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FlipboardRSSFlipboardRSS is a web crawler used by Flipboard to discover articles from RSS feeds and generate article summaries for content curation on the Flipboard platform. It fetc…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FreshRSSFreshRSS is a fetcher operated by FreshRSS.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
FriendicaFriendica is a fetcher operated by Friendica.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
GhostExploreGhostExplore fetches public web pages for Ghost Explore, an aggregation and discovery service operated by Ghost.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
GoodreadsGoodreads is a social cataloging website that allows users to create reading lists, rate and review books, and connect with other readers. The bot fetches content from we…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →