Agent Directory

Fetchers

• AASA-Bot
  AASA-Bot is Apple's crawler that fetches Apple App Site Association files to support Universal Links functionality, allowing iOS apps to handle specific URL patterns.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• AddThis
  AddThis crawls websites to collect metadata and content for social sharing optimization, gathering information needed to populate share buttons, content widgets, and soci…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• AddThis.com
  AddThis.com is a bot operated by Oracle that fetches web content for their social sharing and website tools service. This bot visits websites to gather preview informatio…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• AllAfrica
  AllAfrica is a news aggregation crawler that systematically collects content from over 100 African news organizations and institutions to distribute pan-African news and …
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• AllAfrica NewsBot
  AllAfrica NewsBot is a content fetching bot operated by AllAfrica, a pan-African news aggregation service. The bot visits websites to collect and aggregate news content f…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• allOrigins
  allOrigins is a web fetcher that retrieves requested web resources through the All Origins cross-origin proxy.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• ant-html
  ant-html is a web fetcher operated by Kuaishou that retrieves public web pages for Kuaishou services.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• ArenaUnfurlBot
  ArenaUnfurlBot is a link preview bot operated by Arena, a platform for benchmarking and comparing different AI models. This bot generates link previews when Arena.ai URLs…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• artemis web reader
  artemis web reader is a fetcher operated by capjamesg.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BazQux
  BazQux is a feed fetcher that retrieves RSS/Atom feeds and comments for the BazQux Reader service. It periodically crawls and refreshes user-subscribed feeds to deliver u…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BestChange
  BestChange is the web crawler bot that continuously monitors exchange rates from hundreds of cryptocurrency and e-currency exchangers, updating rate information every 5-8…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BestChange Bot
  BestChange Bot is a web crawler operated by BestChange, a cryptocurrency and e-currency exchange rate monitoring service. The bot visits websites to collect and aggregate…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Bing Preview
  Bing Preview is a fetcher operated by Microsoft.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BingPreview
  BingPreview generates page snapshots and previews for Bing, creating visual representations of web pages for search results using both desktop and mobile variants.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• bitlybot
  bitlybot is a fetcher operated by Bitly.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BlingERP
  BlingERP is an automated data synchronization crawler used by the Bling ERP system to fetch and integrate information from connected ecommerce platforms, marketplaces, an…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Bloglines
  Bloglines is an RSS feed reader and aggregation service operated by Ask Media Group that fetches and parses syndicated content from blogs and websites to display updates …
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Blogtrottr
  Blogtrottr is the RSS feed crawler that fetches content from blogs, news feeds, and websites to deliver updates directly to users' email inboxes, providing automated cont…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Bluesky
  Bluesky social network's link preview bot pre-fetches URLs to generate webpage previews for posts, enabling rich content display in the decentralized social media platfor…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Bluesky Link Preview Service
  Bluesky Link Preview Service is a fetcher operated by Bluesky.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BoardGamePrices Bot
  BoardGamePrices Bot crawls board game retailers to compare prices across 930,622+ games from 284 stores worldwide. It tracks pricing data, stock status, and price drops t…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BubblesBot
  BubblesBot is the web crawler for Bubbles, a community-driven platform that aggregates and ranks blog posts from independent, personal blogs based on user votes and fresh…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BublupBot
  BublupBot is a web crawler operated by Bublup, a content organization and bookmarking platform. This bot fetches previews and metadata from bookmarked content to generate…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• BufferLinkPreviewBot
  BufferLinkPreviewBot is a web crawler operated by Buffer, a social media management platform, that generates rich link previews when users share links in their social med…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Buttondown
  Buttondown is an automated RSS feed crawler that fetches content from blogs and websites to convert them into newsletter content, allowing users to turn their RSS feeds i…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Buttondown RSS-Feed-Parser
  Buttondown RSS-Feed-Parser is a bot used by Buttondown, an email newsletter service, to fetch and parse RSS feeds for their RSS-to-email feature. This allows newsletter c…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• CapitalOneBot
  CapitalOneBot is a web crawler used by Capital One to crawl dealer websites and gather usage information for Capital One's lead navigator button integration. It monitors …
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Citoid
  citoid is Wikimedia's citation generation service that fetches metadata from URLs, DOIs, and ISBNs to automatically create formatted citations in Wikipedia and other wiki…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• ClickUpLinkUnfurler
  ClickUpLinkUnfurler is a bot operated by ClickUp, a project management and productivity platform. It fetches webpage content to generate link previews when users paste UR…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Collapsify
  Collapsify is a Cloudflare internal service that crawls customer error pages to serve them directly from Cloudflare's edge network. This improves performance by caching a…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• ContentStudio
  ContentStudio is a web fetcher operated by ContentStudio that retrieves articles for content discovery, social-media publishing, and link previews.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• ContentStudio-Feed-Fetcher
  ContentStudio-Feed-Fetcher is a web fetcher operated by ContentStudio that retrieves articles from configured feeds for content discovery and publishing workflows.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• ConvermaxBot
  ConvermaxBot is a fetcher.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Cozi-iCalendar-FeedReader
  Cozi-iCalendar-FeedReader periodically fetches external iCalendar feeds to synchronize them with users' Cozi family calendars, enabling automatic updates from school, wor…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Current
  Current is an RSS reader application for iPhone, iPad, and Mac that fetches RSS feeds and articles from websites to deliver content to its users. The bot visits sites to …
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Discordbot
  Discordbot scrapes URLs shared in Discord chats to generate link previews, extracting titles, descriptions, and images to provide contextual content previews within the p…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• dlvr.it
  dlvr.it is a content delivery and social media automation service that fetches content from websites to automatically share and distribute it across various social media …
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• easybill-ImportManager
  easybill-ImportManager is an automated data synchronization tool that fetches order and customer information from external e-commerce systems, marketplaces, and business …
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• EchoboxBot
  EchoboxBot is a crawler operated by Echobox, a social media automation platform designed for publishers that helps manage and optimize content distribution on social medi…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Embedly
  Embedly is a content embedding service that fetches and processes web content to generate rich media previews and embeds for websites and applications. When users share l…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• eMoneyBot
  eMoneyBot is a financial data crawler operated by eMoney Advisor that collects financial information from websites to support their comprehensive financial planning platf…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• EvernoteRichLinkBot
  EvernoteRichLinkBot is a web crawler operated by Evernote, a note-taking and productivity application, that fetches webpage content to generate rich link previews when us…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• facebook
  facebook is a fetcher operated by Meta.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• facebookexternalhit
  facebookexternalhit is Meta's web crawler that fetches content from apps or websites shared on Facebook, Instagram, or Messenger to gather, cache, and display information…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Fastmail Bot
  Fastmail Bot is a fetcher operated by Fastmail.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• FastmailUA
  FastmailUA is Fastmail's content fetcher and image proxy service that retrieves external images and content for email security. It protects users from tracking pixels and…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• FaviconAPI
  FaviconAPI retrieves and caches website favicons for Vemetric's favicon API, which returns site icons to applications from a requested domain.
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• FedReporterDataBot
  FedReporterDataBot automatically downloads financial regulatory data from FFIEC sources including Active/Closed/Branches files, Holding Company data, and Call Report data…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• Feedbin
  Feedbin is an RSS reader service that fetches and aggregates web content, RSS feeds, email newsletters, podcasts, and YouTube videos to provide users with a centralized r…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →
• feedbot
  feedbot is a WordPress.com bot that fetches and delivers RSS feed content to subscribers. It retrieves updated feed content on behalf of WordPress.com users to deliver bl…
  Fetcher

  Fetcher

  Retrieves web page metadata to power app features like link previews or feeds

  See More →