Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
-
A360-SearchA360-Search is a web crawler used by Area360 for collecting and analyzing property information and real estate data from websites.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ActiveComplyActiveComply is a compliance monitoring crawler that systematically scans social media platforms and websites to identify regulatory compliance violations for businesses …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AdagiobotAdagiobot is a web crawler that analyzes websites for advertising demand optimization, helping publishers maximize revenue through real-time bidding analysis and performa…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
adbeat_botadbeat_bot is a web crawler operated by Adbeat, a competitive intelligence platform that tracks and analyzes digital advertising campaigns. The bot collects data about di…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
adidxbotadidxbot is Microsoft's Bing Ads crawler that monitors ads and follows ad destination websites for quality control to ensure advertising standards and policy compliance.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AdkernelTopicCrawlerAdkernelTopicCrawler is a web crawler operated by Adkernel, a white-label ad tech solutions provider. This bot gathers information to support the company's ad network, DS…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
admantxadmantx is an intelligence gatherer operated by Integral Ad Science.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AdmixerBotAdmixerBot is a web crawler operated by Admixer, a digital advertising technology company. It visits web pages to analyze and categorize their content, enabling contextua…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AdpResearchBotAdpResearchBot is operated by ADP and collects publicly available government legal and payroll documents to support regulatory research and guidance for its customers.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AdsBot-GoogleAdsBot-Google is a specialized Google crawler that monitors and analyzes websites where Google Ads are served to ensure quality and policy compliance.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AdsBot-Google-MobileAdsBot-Google-Mobile is a crawler operated by Google that specifically checks mobile web pages for ad quality purposes. The bot ensures ads display correctly on mobile de…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AffsignalCrawlerAffsignalCrawler is a web crawler that collects information about affiliate marketing relationships by mapping affiliate links across websites. It gathers data to help id…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
aiHitBotaiHitBot is a web crawler operated by aiHit that collects business intelligence data about companies and tracks company change events. The collected data is compiled into…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Amazing-SearchBotAmazing-SearchBot is operated by Amazing, an e-commerce education and software platform that provides tools, training, and community resources for entrepreneurs building …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AmazingTest-SearchBotAmazingTest-SearchBot is operated by Amazing, an e-commerce platform that provides tools, training, and community for entrepreneurs building online businesses, particular…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Amazon AdBotAmazon AdBot is an intelligence gatherer operated by Amazon.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Amazon-Advertising-ad-standards-botAmazon-Advertising-ad-standards-bot is Amazon's crawler that verifies ads across the web meet advertising standards and policies.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AmazonAdBotAmazonAdBot is the web crawler used by Amazon's advertising services to visit and analyze advertiser landing pages to ensure compliance with advertising policies and opti…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AmazonProductDiscoveryAmazonProductDiscovery is a web crawler operated by Amazon that discovers and collects product information across the web. This bot is likely used to identify products av…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AndersPinkBotAndersPinkBot is an intelligence gatherer operated by Anders Pink.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ArchiveBotArchiveBot is an intelligence gatherer operated by Wikimedia.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AssaybotAssaybot is a web crawler operated by Index Exchange, an advertising technology company. The bot gathers intelligence about web content and inventory for programmatic adv…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AudigentAdBotAudigentAdBot is a web crawler operated by Audigent that collects metadata from HTML page headers to support targeted advertising solutions. The bot gathers information f…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Automattic Analytics CrawlerAutomattic Analytics Crawler is a web crawler operated by WordPress (Automattic) that gathers analytics and intelligence data from websites. This bot collects information…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AutotouchCompanyCrawlerAutotouchCompanyCrawler collects public company and buyer information for Autotouch. The platform uses this data to research accounts, enrich contacts, prioritize prospec…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AwarioAwario is a social media monitoring bot that crawls over 13 billion web pages daily to track brand mentions, conversations, and social media content across platforms for …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AwarioBotAwarioBot is the web crawler for Awario, a brand monitoring and social listening service. This bot crawls over 13 billion web pages daily to gather brand mentions and dis…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
AwarioSmartBotAwarioSmartBot is a web crawler operated by Awario that collects publicly available web data to help Internet marketers monitor and discover brand mentions online. The bo…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BigUpDataBotBigUpDataBot automates the pipeline of active product deals for advertisement purposes, systematically collecting product pricing and promotional data to support data-dri…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Bing AdsBing Ads is an intelligence gatherer operated by Microsoft.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BitSightBotBitSightBot is an intelligence gatherer operated by Bitsight.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BlackboardBlackboard is an intelligence gatherer operated by Anthology.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BomboraBotBomboraBot is a web crawler operated by Bombora, a B2B data intelligence company that specializes in intent data and audience solutions. The bot collects behavioral data …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BrandVerityBrandVerity is an intelligence gathering bot that monitors online advertising and affiliate marketing activities to detect unauthorized trademark use and policy violation…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BrightEdge BotBrightEdge Bot is an intelligence gatherer operated by BrightEdge.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BuckBuck is a web crawler operated by Hypefactors, a unified PR software platform that provides media monitoring and analytics services. The bot collects media coverage data …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
BuiltWithBuiltWith examines public websites to identify the software, frameworks, and services they use for its technology intelligence products.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CandidOrgWebCheckCandidOrgWebCheck visits nonprofit websites to verify and update organization profiles in Candid's nonprofit and foundation database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
captify-crawlercaptify-crawler gathers web content and contextual signals for Captify's Search Intelligence platform.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
centryx-domain-millcentryx-domain-mill is a web crawler operated by Centryx that collects domain and website information for its B2B prospecting workflows.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
channablechannable bot automates multichannel e-commerce marketing by crawling product data from webshops to optimize feeds, listings, and advertising campaigns across 3000+ platf…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CheckMarkNetworkCheckMarkNetwork is a web crawler operated by CheckMark Network, a brand protection and trademark monitoring company. The bot crawls websites to help clients track their …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CincrawCincraw is an intelligence gatherer operated by CINC.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Clickagy Intelligence BotClickagy Intelligence Bot is a web crawler operated by Clickagy, a company that gathers intelligence and data from websites. This bot is classified as an Intelligence Gat…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Clickagy Intelligence Bot v2Clickagy Intelligence Bot v2 performs advanced ad verification, privacy compliance tracking, and digital advertising intelligence gathering across websites for market ana…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CompanyMapBotCompanyMapBot matches UK business websites to Companies House records using public registration numbers, VAT numbers, addresses, and other company details.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ContextualBotContextualBot is a web crawler operated by Mobian that gathers intelligence and contextual information from websites. This bot is categorized as an intelligence gatherer,…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ContextWebCom-AdsTxtContextWebCom-AdsTxt is a crawler that retrieves ads.txt files for digital-advertising inventory verification.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
contxbotcontxbot is Amazon's web crawler that processes and indexes webpage content to understand website topics and context for delivering relevant advertisements through Amazon…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CriteoBotCriteoBot is Criteo's web crawler that visits and analyzes web pages to understand content and user behavior patterns for serving personalized advertising campaigns.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
Page 1 of 5
Next →