Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
-
PipericBotPipericBot crawls public websites to identify technologies, business categories, and contact details. The data powers Piperic's business-intelligence database for lead ge…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
PostGooBotPostGooBot is a web crawler operated by PostGoo that collects news, podcasts, videos, and social content for its media aggregation platform.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
PostitLeadDiscoveryPostitLeadDiscovery is a web crawler that collects public business contact information for lead research.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
PoweredByBotPoweredByBot scans website homepages for technology fingerprints and declared AI-crawler policies. The data powers the PoweredBy technology-intelligence service operated …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
productsup.io/crawlerproductsup.io/crawler is a web crawler operated by Productsup, a product feed management platform that crawls websites to import product data for e-commerce and marketing…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
PrognostiXonThinMinerPrognostiXonThinMiner collects legislative and government information from public web pages for PrognostiXon's policy-monitoring and legislative-intelligence platform.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
proximicproximic is a contextual advertising crawler that analyzes website content to provide advanced contextual intelligence for programmatic advertising targeting and media op…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
QuantcastbotQuantcastbot is Quantcast's web crawler used for advertisement quality assurance and analyzing page content to build Interest-Based Audiences for targeted advertising and…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
QuuuBotQuuuBot is operated by Quuu, a content curation and social media automation platform that uses machine learning to discover and schedule engaging content for brands to sh…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Qwairy-BotQwairy-Bot is a web crawler operated by Qwairy that collects public web content to monitor brand visibility across AI search systems.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
QwarrybotQwarrybot is a web crawler operated by Qwarry, a French advertising technology company that provides contextual targeting and audience analysis services for programmatic …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
RankshiftFetcherRankshiftFetcher retrieves web pages cited by AI assistants and search engines for Rankshift. The platform uses the content to track brand mentions, source citations, and…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
RankurBotRankurBot is a web crawler operated by Rankur, an online reputation management and social media monitoring service. The bot scans web pages to collect data about brand me…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
RetroListeCOMRetroListeCOM is a monitoring bot that regularly visits gaming websites, particularly Habbo Hotel retros, to collect and track real-time user count statistics for display…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
revops-nuvo-detectorrevops-nuvo-detector scans public websites to identify the software and technologies used by businesses. Nuvo uses these signals for account research supporting its order…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SalesViewerBotSalesViewerBot is an intelligence gatherer operated by SalesViewer.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ScalinthBotScalinthBot is a web crawler operated by Scalinth that collects and updates public company information for its B2B prospecting database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
scoop.itscoop.it is an intelligence gatherer operated by Meltwater.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Scope3The scope3 crawler indexes publicly available web content and paywalled media to assess content classification and brand safety.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
scraping@nytimes.comNYTimes.com newsroom scraping bot collects publicly available, non-copyrighted data for journalistic projects including election result tracking, COVID-19 data aggregatio…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
semantic-visions-analyticasemantic-visions-analytica is a web crawler operated by Semantic Visions that collects public news and web content for risk, compliance, and market-intelligence analysis.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
semantic-visions-infoseekersemantic-visions-infoseeker is a web crawler operated by Semantic Visions that collects public news and web content for risk, compliance, and market-intelligence analysis…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SemanticVisionsBotSemanticVisionsBot collects articles from online news sources and blogs for Semantic Visions' open-source intelligence platform. The platform analyzes multilingual media …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SenderBotSenderBot is a web crawler operated by Sender Online Marketing that collects links and page text for internal analysis of client projects.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SentiBotSentiBot is a web crawler operated by SentiOne that indexes user-generated content for the SentiOne Listen platform. The bot analyzes over 300,000 domains daily from vari…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SirdataBotSirdataBot crawls web pages for Sirdata's Semantic API to analyze and classify content for contextual targeting.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SiteStatsBotSiteStatsBot collects public website metadata and measurements for Site Stats Database, where the information is organized into searchable site profiles and statistics.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SlickBotSlickBot is Slickstream's web crawler that indexes customer websites to power engagement features like site search, content recommendations, and personalization for impro…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
slickstreamslickstream is an intelligence gatherer operated by Slickstream.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SmartologyBotSmartologyBot is a contextual advertising crawler that analyzes web content to generate semantic vectors for matching publisher content with relevant advertisements on th…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SMBsBotSMBsBot collects public company information for SMBs.com's business directory and M&A origination database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SMTBotSMTBot is a web crawler operated by Similarweb that scans websites to detect and catalog the technologies and software tools being used. The collected data powers Similar…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SottopopSottopop is a web crawler operated by UpContent, a content curation and discovery platform that helps marketers find and share relevant articles and content. The bot fetc…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SpamCipherBotSpamCipherBot reads public company websites and job boards to keep business information current for SpamCipher's sales-prospecting and buying-signal features.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Speroll-AdsTxt-CrawlerSperoll-AdsTxt-Crawler retrieves ads.txt files for Speroll Media to verify authorized digital-advertising sellers and validate programmatic inventory.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
StatistikAustriaStatistikAustria crawls e-commerce websites to collect product pricing data for calculating the official consumer price index of Austria, contributing to national economi…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
StormIntelCrawlerStormIntelCrawler gathers hurricane and tropical-storm information for Hurricane Intel, which publishes advisories, forecasts, and analysis from meteorologist Bryan Norcr…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
StripebotStripebot is a web crawler operated by Stripe, a payment processing platform, that fetches and analyzes web content related to merchant websites and online businesses tha…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TaboolaTaboola is an intelligence gatherer operated by Taboola.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TaboolabotTaboolabot is a web crawler used by Taboola to audit advertiser campaign websites, collecting content metadata and site information to enable targeted content recommendat…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TechSpyBotTechSpyBot is an intelligence gathering bot operated by TechSpy. It crawls websites to collect competitive intelligence and market data.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TheWebReportTheWebReport crawls websites to measure technology adoption, performance, security, and implementation quality across the web.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TitanBotTitanBot is a web crawler operated by Titan Materials Corp that collects public construction-industry information for Titan Construction IQ.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
topicsearch-crawlertopicsearch-crawler is a web crawler operated by FatGrid that indexes website topics for marketing, SEO, and business-discovery recommendations.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
tphotobottphotobot scans public web pages for photographs supplied by copyright owners and flags possible unauthorized uses for human review.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
trendictionbottrendictionbot is a web crawler operated by Talkwalker that gathers social media and online content data for social listening, media monitoring, and consumer intelligence…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TrendsmapResolverTrendsmapResolver is an intelligence gatherer operated by Trendsmap.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TTD-ContentTTD-Content is a web crawler that classifies and analyzes webpage content for programmatic advertising purposes, helping advertisers determine brand-safe placement opport…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TurnitinBotTurnitinBot is a web crawler operated by Turnitin, an education technology company that provides plagiarism detection and academic integrity solutions. The bot collects w…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TweetmemeBotTweetmemeBot is an intelligence gatherer operated by Meltwater.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →