Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
-
EzoicBotEzoicBot is a crawler operated by Ezoic, a data-driven ad monetization platform that provides advertising optimization services to website publishers. This bot performs i…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EzoicBot-NicheiqEzoicBot-Nicheiq is a web crawler operated by Ezoic, a platform that provides ad optimization and site testing services for publishers. This bot gathers intelligence abou…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
factset_spyderbotfactset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FDL Stats BotFDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FedicabotFedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FirmCredBotFirmCredBot collects public company information for Firm Cred's directory of B2B service providers. The platform combines website research with verified client reviews an…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FlowIQLabsBotFlowIQLabsBot is an internet-measurement crawler operated by FlowIQ Labs that records protocol, banner, handshake, TLS certificate, and geolocation data from public servi…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ForestEngineForestEngine scans publicly accessible internet services and records TLS certificates, response headers, service banners, and web homepages. The data powers Forest's sear…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
getdomaindatagetdomaindata requests public website homepages and detects technologies such as hosting providers, ecommerce platforms, content management systems, JavaScript frameworks…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GlobRadarBotGlobRadarBot is a web crawler operated by GlobRadar that collects public company and contact information for its Portuguese business database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GnowitNewsbotGnowitNewsbot collects news, government, regulatory, and industry content for Gnowit's media and policy monitoring platform.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google AdsBotGoogle AdsBot is an intelligence gatherer operated by Google.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google AdSenseGoogle AdSense is an intelligence gatherer operated by Google.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google-adstxtGoogle-adstxt is an intelligence gatherer operated by Google.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google-Adwords-InstantGoogle-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google-Display-Ads-BotGoogle-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GovAPIEnricherGovAPIEnricher is a web crawler operated by Mega Impacts that collects public government API information for data enrichment.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GrapeshotCrawlerGrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GroovinaAdsbotGroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GrowthXBotGrowthXBot retrieves public website content for GrowthX's organic-growth platform. GrowthX analyzes the content for search optimization, answer-engine visibility, and con…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
HubSpotHubSpot is an intelligence gatherer operated by HubSpot.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IAS crawlerias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ias-ieias-ie is a web crawler operated by Integral Ad Science, a company that provides digital ad measurement and optimization services. The bot analyzes web page content to as…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IDG/ITIDG/IT is a web scraper operated by SpazioDati, an Italian company specializing in business intelligence and data services. This bot collects publicly available web data …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ImagesiftBotImagesiftBot is an intelligence gatherer operated by Hive.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IncumbINTBotIncumbINTBot is a web crawler operated by Reticle that collects public information about U.S. federal contracting and grants for IncumbINT.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
InngumaInnguma is a web crawler that performs competitive intelligence and technology monitoring by automatically collecting and analyzing information from various sources to he…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IntentBeamBotIntentBeamBot collects public business contact details and leadership information for IntentBeam.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
InteractiveAdvertisingBureauInteractiveAdvertisingBureau crawler by OneTag verifies ads.txt files from publishers to confirm authorized reseller relationships and ad placement authentication for pro…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
InterviewOSInterviewOS is a web crawler operated by Subspace that monitors company career sites and records job openings, closures, and posting duration.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IonCrawlIonCrawl is a web crawler operated by IONOS, a web hosting and cloud services provider. The bot gathers intelligence by crawling websites to collect data for search funct…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Jugendschutzprogramm-CrawlerJugendschutzprogramm-Crawler is a web crawler operated by JusProg, a German youth protection organization that develops filtering software to protect children from inappr…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KargoBotKargoBot is a web crawler operated by Kargo, an advertising technology company that provides ad solutions across mobile, CTV, social media, and e-commerce platforms. The …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KargoBot-Artemis-MobileKargoBot-Artemis-Mobile is a web crawler operated by Kargo, an advertising technology company that creates ad solutions for brands. This mobile bot collects web content i…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KimeBotKimeBot is a web crawler operated by KIME that collects public web content to monitor brand visibility across AI search systems.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KlaviyoKlaviyo is a web tracking script that collects visitor behavior data, product views, and site interactions to enable personalized email and SMS marketing campaigns throug…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KonturbotKonturbot is a web crawler operated by Kontur that collects public business information for its company-data and business-intelligence services.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KStandBotKStandBot is an intelligence gatherer operated by URL Classification.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
LeadFinderBotLeadFinderBot is a web crawler that collects public company and contact information for B2B research.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
LeadForgeLeadForge scans newly discovered websites for NewSiteLead, recording technical, SEO, accessibility, and quality signals. Agencies and consultants use the resulting data t…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
LeikibotLeikibot is a web crawler operated by DoubleVerify that analyzes webpage content for digital advertising verification, brand safety, and ad fraud detection services.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
LightspeedSystemsCrawlerLightspeedSystemsCrawler is an intelligence gatherer operated by Lightspeed Systems.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
linkfluencelinkfluence is an intelligence gatherer operated by Meltwater.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
LinkWalkerLinkWalker is an intelligence gatherer operated by Fortra.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ListSignalBotListSignalBot visits a small number of public pages per site to identify its technology stack, language, and whether it represents an active business. The data powers Lis…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
MacrobondbotMacrobondbot implements custom web crawlers to fetch macroeconomic and financial data from 2,400+ official data sources for Macrobond's integrated research platform. Gath…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
magpie-crawlermagpie-crawler indexes web content and social media posts for Brandwatch's social media monitoring and consumer intelligence platform to analyze brand mentions.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
MantisbotMantisbot is operated by Mantis. It's used to crawl web pages for contextual advertising and brand safety signals.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
MapTheNetBotMapTheNetBot records links between domains to build MapTheNet's web map, rankings, and link data.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
McontextualBotMcontextualBot is a web crawler operated by MContextual that collects content from websites for contextual advertising targeting and analysis. The company uses the crawle…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →