Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Fetchers
-
MonitoRSSMonitoRSS is a Discord bot that polls RSS feeds at regular intervals to deliver highly-customized news feeds directly to Discord channels.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
MuckRackFeedParserMuckRackFeedParser is a feed parsing bot operated by Muck Rack, a platform that connects journalists with public relations professionals. This bot fetches and parses RSS …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewsBlurNewsBlur is a web crawler that fetches RSS feeds and web content for its personal news reader service, collecting articles from subscribed websites and blogs to deliver r…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewsBlur Feed FetcherNewsBlur Feed Fetcher is the bot used by NewsBlur, an RSS feed reader service, to retrieve and update content from RSS and Atom feeds that users have subscribed to. The b…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewsBlur Page FetcherNewsBlur Page Fetcher is a bot operated by NewsBlur, an RSS feed reader and news aggregation service. It fetches content from websites on behalf of subscribers, with the …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NewslitbotNewslitbot is a web crawler operated by Newslit, a media monitoring service that tracks over 100,000 news sources to provide personalized news briefs and content curation…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NextCloudNextCloud is a fetcher operated by Nextcloud.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
NooshubNooshub is a modern RSS reader bot that fetches RSS and Atom feeds and uses learning algorithms to group similar articles, remove clutter, and identify trending topics. I…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OdklBotOdklBot is a crawler that fetches link preview data for the Odnoklassniki social network, extracting Open Graph metadata (titles, descriptions, images) from external link…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OpenGraph.ioOpenGraph.io is a web crawler that extracts Open Graph metadata, titles, descriptions, and images from web pages to generate rich link previews for social sharing platfor…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OpenRSSOpenRSS is a nonprofit RSS feed service bot that crawls websites to generate and provide free RSS feeds, allowing users to follow website updates in a reader app.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Orlo-LinkPreviewOrlo-LinkPreview bot fetches metadata and preview information from URLs that are scheduled for publication in social media posts through the Orlo social media management …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
OvercastOvercast bot fetches RSS feeds and audio metadata from podcast hosting servers to keep the podcast directory and episodes updated for the award-winning iOS podcast player…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Ozon Web GrabberOzon Web Grabber is a fetcher operated by Ozon.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PagePeekerPagePeeker is a website thumbnail and screenshot generation service that visits web pages to capture visual previews of their content. The bot creates preview images that…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PinterestbotPinterestbot is Pinterest's web crawler that fetches content from websites to create previews when users pin links to the platform. The bot collects metadata, images, and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Piqo PodsyncPiqo Podsync is a fetcher bot operated by Piqo that synchronizes or retrieves podcast-related content. Based on its name and designation as a fetcher, it likely accesses …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Pocket Casts Feed ParserPocket Casts Feed Parser fetches and parses podcast RSS feeds to deliver content for playback in the Pocket Casts mobile and web applications.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PocketParserPocketParser is a web crawler operated by Mozilla's Pocket service that fetches and parses web content when users save articles and videos for later reading. The bot extr…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PodchaserParserPodchaserParser is a web crawler operated by Podchaser, a podcast database and discovery platform. This bot fetches podcast-related information from websites to index and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PodimoPodimo is a podcast and audiobook streaming platform bot that fetches content from websites, likely to discover, index, or aggregate podcast episodes and audio content fo…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PressEngine BotPressEngine Bot is a fetcher operated by PressEngine.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
PressEngineBotPressEngineBot is an automated verification crawler that confirms video game press coverage URLs exist and are viewable when submitted by journalists who receive review k…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ProtopageProtopage is an RSS reader and web portal service that crawls and indexes RSS news feeds from various sources to create personalized dashboard start pages and aggregated …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
qcbotqcbot is a web crawler used by QUIC.cloud to fetch data from websites for various online services including image optimization, CSS optimization, and other website perfor…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Quora-BotQuora-Bot is a web crawler operated by Quora, a question-and-answer platform where users can ask questions and get answers from the community. This bot fetches web conten…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
rakutenusabot-imagerakutenusabot-image is a specialized web crawler used by Rakuten to crawl and fetch product images from merchant websites. This enables Rakuten to display cashback deals …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ReadwiseReadwise is a bot that fetches content from web pages to sync highlights and annotations from articles, ebooks, and other reading materials into users' Readwise accounts.…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Readybot.ioReadybot.io is a Discord bot that fetches and monitors RSS feeds, YouTube channels, Reddit posts, Twitch streams, and social media content from platforms like Twitter and…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
redditbotredditbot is a web crawler operated by Reddit, a social news aggregation and discussion platform. This bot fetches web content to create thumbnails and rich previews when…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ReelevantReelevant is a web crawler that fetches product images at runtime to dynamically update content inside email campaigns for personalized marketing experiences.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
reward-gatewayreward-gateway is a web crawler operated by Reward Gateway, an employee experience platform company. The bot likely fetches content related to employee benefits, workplac…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
RSS APIRSS API is a fetcher operated by Tibush.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
RSS.SocialRSS.Social is a fetcher bot that retrieves RSS feeds, likely as part of a service that automates social media posting or manages RSS content distribution.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
rss2tg botrss2tg bot is an automated service that monitors RSS feeds and sends content updates to Telegram channels or users, enabling real-time notifications for feed content.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
RSSAPIRSSAPI is a service that periodically monitors RSS, ATOM, and JSON feeds for customers, parsing and normalizing content, then delivering updates via webhooks in near real…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
RSSExtractorRSSExtractor is a web fetcher that retrieves and extracts RSS feeds from websites.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
scoopit-crawlerscoopit-crawler is a web crawler operated by Scoop.it, a content curation platform that helps users discover, curate, and share content on various topics. The bot fetches…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
scour.ingscour.ing is Scour's AI-powered web crawler that fetches content from RSS feeds and websites to create personalized content recommendations based on user interests.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ScourRSSBotScourRSSBot is a fetcher bot operated by Scour that retrieves RSS feed content from websites. The bot is likely used to collect and aggregate syndicated content for the S…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
serendeputybotserendeputybot is a fetcher operated by Serendeputy.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
SFDC-CalloutSFDC-Callout is the user agent used by Salesforce when making HTTP callouts and API requests from Apex code, workflow rules, and other Salesforce automated processes to e…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
ShortPixelShortPixel is a bot from an image optimization service that compresses and converts images to formats like WebP and AVIF. It visits websites to fetch and optimize images …FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Shortwave Image FetcherShortwave Image Fetcher is a privacy-focused service that proxies images from HTML emails through Shortwave's servers to protect users' IP addresses and maintain email pr…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
SimplePieSimplePie is a fetcher operated by SimplePie.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Skroutz ImageBotSkroutz ImageBot crawls and fetches product images from e-commerce websites to display in Skroutz's price comparison platform, enabling visual product browsing and compar…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
SkroutzBotSkroutzBot is a specialized web crawler used by Skroutz to download XML data feeds, product images, and sample product pages from merchant websites for quality control an…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
SkypeSkype is a fetcher operated by Skype.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
SkypeUriPreviewSkypeUriPreview is Skype's link preview bot that fetches page content when users share URLs in Skype messages, extracting metadata to display rich previews with titles, d…FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →
-
Slack Image ProxySlack Image Proxy is a fetcher operated by Slack.FetcherFetcherRetrieves web page metadata to power app features like link previews or feedsSee More →