Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Fetchers
-
LighthouseBotLighthouseBot is a content aggregation crawler operated by Lighthouse, a feed reader and content curation service. It fetches web feeds and their associated articles, as …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
LinkedInBotLinkedInBot is LinkedIn's web crawler that fetches webpage content to generate link previews and rich cards when URLs are shared on the LinkedIn platform, extracting Open…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
LinkPreviewLinkPreview is a bot operated by Interactive32 that fetches web page metadata to generate link previews with titles, descriptions, and images for developers using the Lin…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
LMArenaUnfurlBotLMArenaUnfurlBot is a fetcher.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
LoomlyBotLoomlyBot is a metadata extraction bot used by Loomly's social media management platform to fetch web page metadata and generate social media post previews. This allows u…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Magnet.me-webMagnet.me-web crawler monitors customer company websites to automatically synchronize and update job opening listings for the Magnet.me recruitment platform. This bot ens…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MagpieRSSMagpieRSS is an RSS feed parser written in PHP that fetches and parses RSS and Atom feeds. This bot visits websites to retrieve RSS feed content, parsing feeds from RSS 0…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Mail.RU_BotMail.RU_Bot fetches web content and metadata for email previews and link processing on behalf of the Mail.ru email service. The bot serves Russian users by providing rich…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MailChimpMailChimp is a bot associated with the Mailchimp email marketing and automation platform. This bot fetches web content that may be linked to or referenced within email ca…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MailRUBotMailRUBot is a fetcher operated by Mail Russia.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MastodonMastodon is a fetcher operated by Mastodon.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Mediumbot-MetaTagFetcherMediumbot-MetaTagFetcher is a bot operated by Medium, an online publishing platform, that fetches meta tag information from web pages. This bot likely visits websites to …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Microsoft PreviewMicrosoft Preview is a fetcher operated by Microsoft.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MicrosoftPreviewMicrosoftPreview is a web crawler that generates page snapshots and link previews for Microsoft products and services, extracting metadata and visual content to create ri…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MinifluxMiniflux is a minimalist feed reader application that fetches RSS and web feeds to aggregate content for its users. This bot retrieves feed content and updates on behalf …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MissinglettrBotMissinglettrBot is a web crawler that automatically detects and fetches blog post content from customer websites to create automated social media drip campaigns and marke…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MonitoRSSMonitoRSS is a Discord bot that polls RSS feeds at regular intervals to deliver highly-customized news feeds directly to Discord channels.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MuckRackFeedParserMuckRackFeedParser is a feed parsing bot operated by Muck Rack, a platform that connects journalists with public relations professionals. This bot fetches and parses RSS …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewsBlurNewsBlur is a web crawler that fetches RSS feeds and web content for its personal news reader service, collecting articles from subscribed websites and blogs to deliver r…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewsBlur Feed FetcherNewsBlur Feed Fetcher is the bot used by NewsBlur, an RSS feed reader service, to retrieve and update content from RSS and Atom feeds that users have subscribed to. The b…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewsBlur Page FetcherNewsBlur Page Fetcher is a bot operated by NewsBlur, an RSS feed reader and news aggregation service. It fetches content from websites on behalf of subscribers, with the …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewslitbotNewslitbot is a web crawler operated by Newslit, a media monitoring service that tracks over 100,000 news sources to provide personalized news briefs and content curation…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NextCloudNextCloud is a fetcher operated by Nextcloud.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NooshubNooshub is a modern RSS reader bot that fetches RSS and Atom feeds and uses learning algorithms to group similar articles, remove clutter, and identify trending topics. I…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OdklBotOdklBot is a crawler that fetches link preview data for the Odnoklassniki social network, extracting Open Graph metadata (titles, descriptions, images) from external link…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OpenGraph.ioOpenGraph.io is a web crawler that extracts Open Graph metadata, titles, descriptions, and images from web pages to generate rich link previews for social sharing platfor…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OpenRSSOpenRSS is a nonprofit RSS feed service bot that crawls websites to generate and provide free RSS feeds, allowing users to follow website updates in a reader app.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Orlo-LinkPreviewOrlo-LinkPreview bot fetches metadata and preview information from URLs that are scheduled for publication in social media posts through the Orlo social media management …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OvercastOvercast bot fetches RSS feeds and audio metadata from podcast hosting servers to keep the podcast directory and episodes updated for the award-winning iOS podcast player…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Ozon Web GrabberOzon Web Grabber is a fetcher operated by Ozon.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PagePeekerPagePeeker is a website thumbnail and screenshot generation service that visits web pages to capture visual previews of their content. The bot creates preview images that…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PinterestbotPinterestbot is Pinterest's web crawler that fetches content from websites to create previews when users pin links to the platform. The bot collects metadata, images, and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Piqo PodsyncPiqo Podsync is a fetcher bot operated by Piqo that synchronizes or retrieves podcast-related content. Based on its name and designation as a fetcher, it likely accesses …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Pocket Casts Feed ParserPocket Casts Feed Parser fetches and parses podcast RSS feeds to deliver content for playback in the Pocket Casts mobile and web applications.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PocketParserPocketParser is a web crawler operated by Mozilla's Pocket service that fetches and parses web content when users save articles and videos for later reading. The bot extr…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PodchaserParserPodchaserParser is a web crawler operated by Podchaser, a podcast database and discovery platform. This bot fetches podcast-related information from websites to index and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PodimoPodimo is a podcast and audiobook streaming platform bot that fetches content from websites, likely to discover, index, or aggregate podcast episodes and audio content fo…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PressEngine BotPressEngine Bot is a fetcher operated by PressEngine.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PressEngineBotPressEngineBot is an automated verification crawler that confirms video game press coverage URLs exist and are viewable when submitted by journalists who receive review k…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ProtopageProtopage is an RSS reader and web portal service that crawls and indexes RSS news feeds from various sources to create personalized dashboard start pages and aggregated …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
qcbotqcbot is a web crawler used by QUIC.cloud to fetch data from websites for various online services including image optimization, CSS optimization, and other website perfor…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Quora-BotQuora-Bot is a web crawler operated by Quora, a question-and-answer platform where users can ask questions and get answers from the community. This bot fetches web conten…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
rakutenusabot-imagerakutenusabot-image is a specialized web crawler used by Rakuten to crawl and fetch product images from merchant websites. This enables Rakuten to display cashback deals …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ReadwiseReadwise is a bot that fetches content from web pages to sync highlights and annotations from articles, ebooks, and other reading materials into users' Readwise accounts.…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Readybot.ioReadybot.io is a Discord bot that fetches and monitors RSS feeds, YouTube channels, Reddit posts, Twitch streams, and social media content from platforms like Twitter and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
redditbotredditbot is a web crawler operated by Reddit, a social news aggregation and discussion platform. This bot fetches web content to create thumbnails and rich previews when…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ReelevantReelevant is a web crawler that fetches product images at runtime to dynamically update content inside email campaigns for personalized marketing experiences.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
reward-gatewayreward-gateway is a web crawler operated by Reward Gateway, an employee experience platform company. The bot likely fetches content related to employee benefits, workplac…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
RSS APIRSS API is a fetcher operated by Tibush.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
RSS.SocialRSS.Social is a fetcher bot that retrieves RSS feeds, likely as part of a service that automates social media posting or manages RSS content distribution.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →