Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
-
revops-nuvo-detectorrevops-nuvo-detector scans public websites to identify the software and technologies used by businesses. Nuvo uses these signals for account research supporting its order…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SalesViewerBotSalesViewerBot is an intelligence gatherer operated by SalesViewer.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ScalinthBotScalinthBot is a web crawler operated by Scalinth that collects and updates public company information for its B2B prospecting database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
scoop.itscoop.it is an intelligence gatherer operated by Meltwater.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Scope3The scope3 crawler indexes publicly available web content and paywalled media to assess content classification and brand safety.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
scraping@nytimes.comNYTimes.com newsroom scraping bot collects publicly available, non-copyrighted data for journalistic projects including election result tracking, COVID-19 data aggregatio…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
semantic-visions-analyticasemantic-visions-analytica is a web crawler operated by Semantic Visions that collects public news and web content for risk, compliance, and market-intelligence analysis.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
semantic-visions-infoseekersemantic-visions-infoseeker is a web crawler operated by Semantic Visions that collects public news and web content for risk, compliance, and market-intelligence analysis…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SemanticVisionsBotSemanticVisionsBot collects articles from online news sources and blogs for Semantic Visions' open-source intelligence platform. The platform analyzes multilingual media …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SenderBotSenderBot is a web crawler operated by Sender Online Marketing that collects links and page text for internal analysis of client projects.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SentiBotSentiBot is a web crawler operated by SentiOne that indexes user-generated content for the SentiOne Listen platform. The bot analyzes over 300,000 domains daily from vari…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SirdataBotSirdataBot crawls web pages for Sirdata's Semantic API to analyze and classify content for contextual targeting.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SiteStatsBotSiteStatsBot collects public website metadata and measurements for Site Stats Database, where the information is organized into searchable site profiles and statistics.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SlickBotSlickBot is Slickstream's web crawler that indexes customer websites to power engagement features like site search, content recommendations, and personalization for impro…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
slickstreamslickstream is an intelligence gatherer operated by Slickstream.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SmartologyBotSmartologyBot is a contextual advertising crawler that analyzes web content to generate semantic vectors for matching publisher content with relevant advertisements on th…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SMBsBotSMBsBot collects public company information for SMBs.com's business directory and M&A origination database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SMTBotSMTBot is a web crawler operated by Similarweb that scans websites to detect and catalog the technologies and software tools being used. The collected data powers Similar…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SottopopSottopop is a web crawler operated by UpContent, a content curation and discovery platform that helps marketers find and share relevant articles and content. The bot fetc…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
SpamCipherBotSpamCipherBot reads public company websites and job boards to keep business information current for SpamCipher's sales-prospecting and buying-signal features.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Speroll-AdsTxt-CrawlerSperoll-AdsTxt-Crawler retrieves ads.txt files for Speroll Media to verify authorized digital-advertising sellers and validate programmatic inventory.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
StatistikAustriaStatistikAustria crawls e-commerce websites to collect product pricing data for calculating the official consumer price index of Austria, contributing to national economi…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
StormIntelCrawlerStormIntelCrawler gathers hurricane and tropical-storm information for Hurricane Intel, which publishes advisories, forecasts, and analysis from meteorologist Bryan Norcr…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
StripebotStripebot is a web crawler operated by Stripe, a payment processing platform, that fetches and analyzes web content related to merchant websites and online businesses tha…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TaboolaTaboola is an intelligence gatherer operated by Taboola.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TaboolabotTaboolabot is a web crawler used by Taboola to audit advertiser campaign websites, collecting content metadata and site information to enable targeted content recommendat…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TechSpyBotTechSpyBot is an intelligence gathering bot operated by TechSpy. It crawls websites to collect competitive intelligence and market data.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TheWebReportTheWebReport crawls websites to measure technology adoption, performance, security, and implementation quality across the web.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TitanBotTitanBot is a web crawler operated by Titan Materials Corp that collects public construction-industry information for Titan Construction IQ.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
topicsearch-crawlertopicsearch-crawler is a web crawler operated by FatGrid that indexes website topics for marketing, SEO, and business-discovery recommendations.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
tphotobottphotobot scans public web pages for photographs supplied by copyright owners and flags possible unauthorized uses for human review.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
trendictionbottrendictionbot is a web crawler operated by Talkwalker that gathers social media and online content data for social listening, media monitoring, and consumer intelligence…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TrendsmapResolverTrendsmapResolver is an intelligence gatherer operated by Trendsmap.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TTD-ContentTTD-Content is a web crawler that classifies and analyzes webpage content for programmatic advertising purposes, helping advertisers determine brand-safe placement opport…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TurnitinBotTurnitinBot is a web crawler operated by Turnitin, an education technology company that provides plagiarism detection and academic integrity solutions. The bot collects w…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TweetmemeBotTweetmemeBot is an intelligence gatherer operated by Meltwater.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
TwinglyTwingly is an intelligence gatherer operated by Twingly.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Twingly Recon-SjostromTwingly Recon-Sjostrom is a web crawler operated by Twingly, a company that provides social data and news data from millions of online sources including news sites, blogs…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
uipbotuipbot is a web crawler operated by Semasio, a semantic targeting and advertising technology company that analyzes web content to understand its meaning and context for d…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
um-FCum-FC is a web crawler operated by Ubermetrics Technologies, a company that develops solutions for media monitoring and communications intelligence. This bot collects pub…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
um-ICum-IC is a web crawler operated by Ubermetrics Technologies, the research and development arm of the UNICEPTA Group. The bot collects web content to support advanced solu…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
um-LNum-LN is a web crawler operated by Ubermetrics Technologies, the research and development center of the UNICEPTA Group. This bot collects web content to support AI-based …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
UpContentUpContent is a web crawler that finds relevant public articles for people to review, curate, and share with their audiences, helping publishers reach engaged human reader…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
UpContent-QAUpContent-QA is a QA crawler that requests public articles to test UpContent's human-focused content discovery and curation system before production use.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
UpContent-TestUpContent-Test is a test web crawler operated by UpContent that requests public web pages to validate UpContent crawler behavior and content discovery systems.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
VerityVerity is a web crawler operated by GumGum, a contextual advertising technology company. The bot analyzes web page content including text, images, audio, and video to ena…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
virustotalvirustotal is an intelligence gatherer operated by VirusTotal.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
WappalyzerBotWappalyzerBot examines public websites to identify the technologies they use, supplying technology profiles and market intelligence for Wappalyzer customers.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
weborama-fetcherweborama-fetcher is a web crawler operated by Weborama, an AdTech company specializing in data-driven digital advertising solutions. This bot collects information from we…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
webspidermountwebspidermount is a professional job wrapping service that extracts job listings from employer websites and distributes them to job boards, recruitment platforms, and job…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →