Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Intelligence Gatherers
-
cXensebotcXensebot is Cxense's web crawler that performs content indexing and behavioral data collection to power Piano's customer data platform, enabling real-time analytics and …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
CypressGrowthDiligenceCypressGrowthDiligence is a web crawler that reads public company about and team pages for private-company sourcing.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DataproviderDataprovider is a web crawler that indexes over 700 million domains to create a structured database of website information, technologies, and business insights for data i…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Dataprovider.comDataprovider.com is an intelligence gatherer operated by Dataprovider.com.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DomainDriftDomainDrift continuously monitors a large catalog of domains for changes to nameservers, mail servers, TLS certificates, hosting providers, and other infrastructure. It p…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DragonflyDragonfly is a web crawler operated by Publisher Discovery that gathers intelligence about publishers and websites. It is used to discover and collect information about o…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ds9ds9 is operated by Copyright Clearance Center and crawls websites to gather information about published content for copyright licensing and rights management purposes. Th…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
DVbotDVbot is operated by DoubleVerify, a digital advertising verification company that monitors and measures media transactions across websites to ensure ad quality, detect f…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
dwelltime-botdwelltime-bot is a web crawler operated by Dwell that collects public content for personalized daily recommendations.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Echobot BotEchobot Bot is an intelligence gatherer operated by Echobox.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EcoVadisSustainabilityBotEcoVadisSustainabilityBot is a web crawler operated by EcoVadis, a company that provides sustainability ratings and intelligence for businesses and their supply chains. T…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EpivozCrawlerEpivozCrawler is Techmeme's web crawler that systematically crawls news articles and blog posts to gather information for Techmeme's technology news aggregation service.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ev-crawlerev-crawler is an intelligence gatherer operated by Headline.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EzLynxEzLynx is a web crawler operated by Ezoic, a platform that provides website optimization and ad testing services. This bot gathers intelligence from websites to help anal…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EzoicBotEzoicBot is a crawler operated by Ezoic, a data-driven ad monetization platform that provides advertising optimization services to website publishers. This bot performs i…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
EzoicBot-NicheiqEzoicBot-Nicheiq is a web crawler operated by Ezoic, a platform that provides ad optimization and site testing services for publishers. This bot gathers intelligence abou…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
factset_spyderbotfactset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and a…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FDL Stats BotFDL Stats Bot crawls publicly available Rocket League player data from various platforms to generate analytical statistics for the Frontier Doubles League competition.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FedicabotFedicabot is a web crawler operated by Fedica, a social media analytics and publishing platform. It likely visits websites to gather data related to social media content …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FirmCredBotFirmCredBot collects public company information for Firm Cred's directory of B2B service providers. The platform combines website research with verified client reviews an…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
FlowIQLabsBotFlowIQLabsBot is an internet-measurement crawler operated by FlowIQ Labs that records protocol, banner, handshake, TLS certificate, and geolocation data from public servi…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ForestEngineForestEngine scans publicly accessible internet services and records TLS certificates, response headers, service banners, and web homepages. The data powers Forest's sear…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
getdomaindatagetdomaindata requests public website homepages and detects technologies such as hosting providers, ecommerce platforms, content management systems, JavaScript frameworks…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GlobRadarBotGlobRadarBot is a web crawler operated by GlobRadar that collects public company and contact information for its Portuguese business database.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GnowitNewsbotGnowitNewsbot collects news, government, regulatory, and industry content for Gnowit's media and policy monitoring platform.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google AdsBotGoogle AdsBot is an intelligence gatherer operated by Google.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google AdSenseGoogle AdSense is an intelligence gatherer operated by Google.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google-adstxtGoogle-adstxt is an intelligence gatherer operated by Google.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google-Adwords-InstantGoogle-Adwords-Instant is the web crawler bot connected to the Google Ads platform that visits advertiser landing pages to perform quality checks, verification, and compl…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Google-Display-Ads-BotGoogle-Display-Ads-Bot is operated by Google and crawls websites to analyze their content for contextual ad targeting and placement in the Google Display Network. This bo…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GovAPIEnricherGovAPIEnricher is a web crawler operated by Mega Impacts that collects public government API information for data enrichment.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GrapeshotCrawlerGrapeshotCrawler analyzes web content for Oracle Advertising's contextual targeting system, classifying pages to ensure brand-safe ad placements.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GroovinaAdsbotGroovinaAdsbot is the web crawler used by Groovinads to gather data from e-commerce websites and digital advertising spaces to support their AI-powered display campaign o…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
GrowthXBotGrowthXBot retrieves public website content for GrowthX's organic-growth platform. GrowthX analyzes the content for search optimization, answer-engine visibility, and con…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
HubSpotHubSpot is an intelligence gatherer operated by HubSpot.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IAS crawlerias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ias-ieias-ie is a web crawler operated by Integral Ad Science, a company that provides digital ad measurement and optimization services. The bot analyzes web page content to as…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IDG/ITIDG/IT is a web scraper operated by SpazioDati, an Italian company specializing in business intelligence and data services. This bot collects publicly available web data …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
ImagesiftBotImagesiftBot is an intelligence gatherer operated by Hive.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IncumbINTBotIncumbINTBot is a web crawler operated by Reticle that collects public information about U.S. federal contracting and grants for IncumbINT.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
InngumaInnguma is a web crawler that performs competitive intelligence and technology monitoring by automatically collecting and analyzing information from various sources to he…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IntentBeamBotIntentBeamBot collects public business contact details and leadership information for IntentBeam.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
InteractiveAdvertisingBureauInteractiveAdvertisingBureau crawler by OneTag verifies ads.txt files from publishers to confirm authorized reseller relationships and ad placement authentication for pro…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
InterviewOSInterviewOS is a web crawler operated by Subspace that monitors company career sites and records job openings, closures, and posting duration.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
IonCrawlIonCrawl is a web crawler operated by IONOS, a web hosting and cloud services provider. The bot gathers intelligence by crawling websites to collect data for search funct…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
Jugendschutzprogramm-CrawlerJugendschutzprogramm-Crawler is a web crawler operated by JusProg, a German youth protection organization that develops filtering software to protect children from inappr…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KargoBotKargoBot is a web crawler operated by Kargo, an advertising technology company that provides ad solutions across mobile, CTV, social media, and e-commerce platforms. The …Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KargoBot-Artemis-MobileKargoBot-Artemis-Mobile is a web crawler operated by Kargo, an advertising technology company that creates ad solutions for brands. This mobile bot collects web content i…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KimeBotKimeBot is a web crawler operated by KIME that collects public web content to monitor brand visibility across AI search systems.Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →
-
KlaviyoKlaviyo is a web tracking script that collects visitor behavior data, product views, and site interactions to enable personalized email and SMS marketing campaigns throug…Intelligence GathererIntelligence GathererAnalyzes web content for brand safety, competitive insights, and ad targetingSee More →