Agents & Bots
Add an Agent
All Categories
A directory of every known AI agent, crawler, scraper, and other bot on the internet.
Fetchers
Superfeedr
Superfeedr is a fetcher operated by Superfeedr.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Superfeedr bot
Superfeedr bot is a feed fetching crawler operated by Superfeedr, a real-time RSS and feed API service. The bot retrieves and parses feeds on behalf of subscribers, provi…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
SurdotlyBot
SurdotlyBot is the web crawler for Sur.ly, a content preview and link shortening service. This bot fetches content to generate previews and thumbnails for links shared th…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Synapse
Synapse is a fetcher operated by Matrix.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Telegram Bot
Telegram Bot is a fetcher operated by Telegram.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
TelegramBot
TelegramBot is Telegram's web crawler that fetches webpage content to generate Instant View pages and link previews for users, enabling rich content display directly with…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
TikTokSpider
TikTokSpider is a web crawler operated by TikTok that fetches content from websites when users share external URLs on the platform. The bot collects information for link …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Tiny Tiny RSS
Tiny Tiny RSS is a fetcher operated by Tiny Tiny RSS.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Tumblr
Tumblr is Automattic's link unfurling bot that fetches URL content to create rich Link Blocks in Tumblr posts, parsing responses to display titles, descriptions, and prev…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Twitterbot
Twitterbot crawls web pages to generate Twitter Cards, fetching metadata like titles, descriptions, and images for link previews when URLs are shared on X (formerly Twitt…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
upday
upday crawls news websites and sources to aggregate articles for its news app platform, collecting and indexing content to provide personalized news recommendations.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Viber
Viber is a fetcher operated by Viber.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
videootvBot
videootvBot is a crawler that extracts the newest articles from publisher websites via feeds or HTML parsing to create carousels with images, links and text for native ad…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
vkShare
vkShare is a fetcher bot operated by VK, a social networking platform. It visits web pages when users share links on the VK network to collect preview information such as…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
WhatsApp
WhatsApp is a fetcher operated by Meta.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
WireReaderBot
WireReaderBot is the crawler for Wire RSS Reader, a modern news reader application that aggregates RSS feeds. The bot fetches full article content from websites so that W…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
WordCountBot
WordCountBot is a website analysis crawler that scans public web pages to count words in HTML source code, including SEO tags, to help estimate website translation costs …
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
WovnCrawler
WovnCrawler is a web crawler used by WOVN.io website localization service to retrieve source language content from client websites for translation and multilingual websit…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Yahoo Link Preview
Yahoo Link Preview bot fetches metadata and preview data from URLs shared on Yahoo platforms and services. Supports Yahoo's social features, news aggregation, and content…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
YahooMailProxy
YahooMailProxy retrieves and caches webpage content from URLs embedded in Yahoo Mail emails, improving security and reducing bandwidth usage for email users.
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
YelpBot
YelpBot is a web crawler operated by Yelp, the popular business review and local search service. This bot fetches content from business websites to gather information suc…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
ZoteroTranslationServer
ZoteroTranslationServer extracts citation metadata from URLs, DOIs, and ISBNs using Zotero translators to power Wikimedia's Citoid service for automated reference generat…
Fetcher
Fetcher
Retrieves web page metadata to power app features like link previews or feeds
See More →
Intelligence Gatherers
A360-Search
A360-Search is a web crawler used by Area360 for collecting and analyzing property information and real estate data from websites.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ActiveComply
ActiveComply is a compliance monitoring crawler that systematically scans social media platforms and websites to identify regulatory compliance violations for businesses …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Adagiobot
Adagiobot is a web crawler that analyzes websites for advertising demand optimization, helping publishers maximize revenue through real-time bidding analysis and performa…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
adbeat_bot
adbeat_bot is a web crawler operated by Adbeat, a competitive intelligence platform that tracks and analyzes digital advertising campaigns. The bot collects data about di…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
adidxbot
adidxbot is Microsoft's Bing Ads crawler that monitors ads and follows ad destination websites for quality control to ensure advertising standards and policy compliance.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AdkernelTopicCrawler
AdkernelTopicCrawler is a web crawler operated by Adkernel, a white-label ad tech solutions provider. This bot gathers information to support the company's ad network, DS…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
admantx
admantx is an intelligence gatherer operated by Integral Ad Science.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AdmixerBot
AdmixerBot is a web crawler operated by Admixer, a digital advertising technology company. It visits web pages to analyze and categorize their content, enabling contextua…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AdsBot-Google
AdsBot-Google is a specialized Google crawler that monitors and analyzes websites where Google Ads are served to ensure quality and policy compliance.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AdsBot-Google-Mobile
AdsBot-Google-Mobile is a crawler operated by Google that specifically checks mobile web pages for ad quality purposes. The bot ensures ads display correctly on mobile de…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AffsignalCrawler
AffsignalCrawler is a web crawler that collects information about affiliate marketing relationships by mapping affiliate links across websites. It gathers data to help id…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
aiHitBot
aiHitBot is a web crawler operated by aiHit that collects business intelligence data about companies and tracks company change events. The collected data is compiled into…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Amazing-SearchBot
Amazing-SearchBot is operated by Amazing, an e-commerce education and software platform that provides tools, training, and community resources for entrepreneurs building …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AmazingTest-SearchBot
AmazingTest-SearchBot is operated by Amazing, an e-commerce platform that provides tools, training, and community for entrepreneurs building online businesses, particular…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Amazon AdBot
Amazon AdBot is an intelligence gatherer operated by Amazon.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Amazon-Advertising-ad-standards-bot
Amazon-Advertising-ad-standards-bot is Amazon's crawler that verifies ads across the web meet advertising standards and policies.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AmazonAdBot
AmazonAdBot is the web crawler used by Amazon's advertising services to visit and analyze advertiser landing pages to ensure compliance with advertising policies and opti…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AmazonProductDiscovery
AmazonProductDiscovery is a web crawler operated by Amazon that discovers and collects product information across the web. This bot is likely used to identify products av…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AndersPinkBot
AndersPinkBot is an intelligence gatherer operated by Anders Pink.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
ArchiveBot
ArchiveBot is an intelligence gatherer operated by Wikimedia.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Assaybot
Assaybot is a web crawler operated by Index Exchange, an advertising technology company. The bot gathers intelligence about web content and inventory for programmatic adv…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AudigentAdBot
AudigentAdBot is a web crawler operated by Audigent that collects metadata from HTML page headers to support targeted advertising solutions. The bot gathers information f…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Automattic Analytics Crawler
Automattic Analytics Crawler is a web crawler operated by WordPress (Automattic) that gathers analytics and intelligence data from websites. This bot collects information…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Awario
Awario is a social media monitoring bot that crawls over 13 billion web pages daily to track brand mentions, conversations, and social media content across platforms for …
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AwarioBot
AwarioBot is the web crawler for Awario, a brand monitoring and social listening service. This bot crawls over 13 billion web pages daily to gather brand mentions and dis…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
AwarioSmartBot
AwarioSmartBot is a web crawler operated by Awario that collects publicly available web data to help Internet marketers monitor and discover brand mentions online. The bo…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
BigUpDataBot
BigUpDataBot automates the pipeline of active product deals for advertisement purposes, systematically collecting product pricing and promotional data to support data-dri…
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →
Bing Ads
Bing Ads is an intelligence gatherer operated by Microsoft.
Intelligence Gatherer
Intelligence Gatherer
Analyzes web content for brand safety, competitive insights, and ad targeting
See More →