Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
-
AmazingTest-SearchBotAmazingTest-SearchBot is operated by Amazing, an e-commerce platform that provides tools, training, and community for entrepreneurs building online businesses, particular…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Amazon AdBotAmazon AdBot is an intelligence gatherer operated by Amazon.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Amazon-Advertising-ad-standards-botAmazon-Advertising-ad-standards-bot is Amazon's crawler that verifies ads across the web meet advertising standards and policies.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AmazonAdBotAmazonAdBot is the web crawler used by Amazon's advertising services to visit and analyze advertiser landing pages to ensure compliance with advertising policies and opti…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AmazonProductDiscoveryAmazonProductDiscovery is a web crawler operated by Amazon that discovers and collects product information across the web. This bot is likely used to identify products av…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AndersPinkBotAndersPinkBot is an intelligence gatherer operated by Anders Pink.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ArchiveBotArchiveBot is an intelligence gatherer operated by Wikimedia.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AssaybotAssaybot is a web crawler operated by Index Exchange, an advertising technology company. The bot gathers intelligence about web content and inventory for programmatic adv…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AudigentAdBotAudigentAdBot is a web crawler operated by Audigent that collects metadata from HTML page headers to support targeted advertising solutions. The bot gathers information f…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Automattic Analytics CrawlerAutomattic Analytics Crawler is a web crawler operated by WordPress (Automattic) that gathers analytics and intelligence data from websites. This bot collects information…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AutotouchCompanyCrawlerAutotouchCompanyCrawler collects public company and buyer information for Autotouch. The platform uses this data to research accounts, enrich contacts, prioritize prospec…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AwarioAwario is a social media monitoring bot that crawls over 13 billion web pages daily to track brand mentions, conversations, and social media content across platforms for …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AwarioBotAwarioBot is the web crawler for Awario, a brand monitoring and social listening service. This bot crawls over 13 billion web pages daily to gather brand mentions and dis…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AwarioSmartBotAwarioSmartBot is a web crawler operated by Awario that collects publicly available web data to help Internet marketers monitor and discover brand mentions online. The bo…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BigUpDataBotBigUpDataBot automates the pipeline of active product deals for advertisement purposes, systematically collecting product pricing and promotional data to support data-dri…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Bing AdsBing Ads is an intelligence gatherer operated by Microsoft.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BitSightBotBitSightBot is an intelligence gatherer operated by Bitsight.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BlackboardBlackboard is an intelligence gatherer operated by Anthology.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BomboraBotBomboraBot is a web crawler operated by Bombora, a B2B data intelligence company that specializes in intent data and audience solutions. The bot collects behavioral data …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BrandVerityBrandVerity is an intelligence gathering bot that monitors online advertising and affiliate marketing activities to detect unauthorized trademark use and policy violation…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BrightEdge BotBrightEdge Bot is an intelligence gatherer operated by BrightEdge.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BuckBuck is a web crawler operated by Hypefactors, a unified PR software platform that provides media monitoring and analytics services. The bot collects media coverage data …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BuiltWithBuiltWith examines public websites to identify the software, frameworks, and services they use for its technology intelligence products.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CandidOrgWebCheckCandidOrgWebCheck visits nonprofit websites to verify and update organization profiles in Candid's nonprofit and foundation database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
captify-crawlercaptify-crawler gathers web content and contextual signals for Captify's Search Intelligence platform.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
centryx-domain-millcentryx-domain-mill is a web crawler operated by Centryx that collects domain and website information for its B2B prospecting workflows.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
channablechannable bot automates multichannel e-commerce marketing by crawling product data from webshops to optimize feeds, listings, and advertising campaigns across 3000+ platf…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CheckMarkNetworkCheckMarkNetwork is a web crawler operated by CheckMark Network, a brand protection and trademark monitoring company. The bot crawls websites to help clients track their …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CincrawCincraw is an intelligence gatherer operated by CINC.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Clickagy Intelligence BotClickagy Intelligence Bot is a web crawler operated by Clickagy, a company that gathers intelligence and data from websites. This bot is classified as an Intelligence Gat…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Clickagy Intelligence Bot v2Clickagy Intelligence Bot v2 performs advanced ad verification, privacy compliance tracking, and digital advertising intelligence gathering across websites for market ana…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CompanyMapBotCompanyMapBot matches UK business websites to Companies House records using public registration numbers, VAT numbers, addresses, and other company details.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ContextualBotContextualBot is a web crawler operated by Mobian that gathers intelligence and contextual information from websites. This bot is categorized as an intelligence gatherer,…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ContextWebCom-AdsTxtContextWebCom-AdsTxt is a crawler that retrieves ads.txt files for digital-advertising inventory verification.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
contxbotcontxbot is Amazon's web crawler that processes and indexes webpage content to understand website topics and context for delivering relevant advertisements through Amazon…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CriteoBotCriteoBot is Criteo's web crawler that visits and analyzes web pages to understand content and user behavior patterns for serving personalized advertising campaigns.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
cXensebotcXensebot is Cxense's web crawler that performs content indexing and behavioral data collection to power Piano's customer data platform, enabling real-time analytics and …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CypressGrowthDiligenceCypressGrowthDiligence is a web crawler that reads public company about and team pages for private-company sourcing.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DataproviderDataprovider is a web crawler that indexes over 700 million domains to create a structured database of website information, technologies, and business insights for data i…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Dataprovider.comDataprovider.com is an intelligence gatherer operated by Dataprovider.com.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DomainDriftDomainDrift continuously monitors a large catalog of domains for changes to nameservers, mail servers, TLS certificates, hosting providers, and other infrastructure. It p…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DragonflyDragonfly is a web crawler operated by Publisher Discovery that gathers intelligence about publishers and websites. It is used to discover and collect information about o…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ds9ds9 is operated by Copyright Clearance Center and crawls websites to gather information about published content for copyright licensing and rights management purposes. Th…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DVbotDVbot is operated by DoubleVerify, a digital advertising verification company that monitors and measures media transactions across websites to ensure ad quality, detect f…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
dwelltime-botdwelltime-bot is a web crawler operated by Dwell that collects public content for personalized daily recommendations.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Echobot BotEchobot Bot is an intelligence gatherer operated by Echobox.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EcoVadisSustainabilityBotEcoVadisSustainabilityBot is a web crawler operated by EcoVadis, a company that provides sustainability ratings and intelligence for businesses and their supply chains. T…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EpivozCrawlerEpivozCrawler is Techmeme's web crawler that systematically crawls news articles and blog posts to gather information for Techmeme's technology news aggregation service.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ev-crawlerev-crawler is an intelligence gatherer operated by Headline.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EzLynxEzLynx is a web crawler operated by Ezoic, a platform that provides website optimization and ad testing services. This bot gathers intelligence from websites to help anal…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →