Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Search Engine Crawlers
-
YahooCacheSystemYahooCacheSystem is a web caching component that stores website content snapshots as part of Yahoo's search infrastructure, working alongside Yahoo Slurp crawler to impro…Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
yandexyandex is a search engine crawler operated by Yandex.Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YandexBotYandexBot is the web crawler for Yandex, a major Russian search engine. It visits websites to index content and make it searchable through Yandex's search results.Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YandexImagesYandexImages is a web crawler operated by Yandex that specifically crawls and indexes images for Yandex's image search service. This bot discovers and collects images fro…Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YandexMobileBotYandexMobileBot is a web crawler operated by Yandex, Russia's largest search engine. It crawls mobile versions of websites and simulates mobile device traffic to ensure p…Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YandexRenderResourcesBotYandexRenderResourcesBot is a search engine crawler operated by Yandex, Russia's largest search engine. This bot fetches and renders web page resources like CSS, JavaScri…Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YandexVertisYandexVertis is a web crawler operated by Yandex, Russia's largest search engine. This bot discovers and indexes web content as part of Yandex's search infrastructure to …Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YetiYeti is Naver's web crawler that systematically discovers and indexes web content for South Korea's largest search engine. It crawls websites to build Naver's search inde…Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
Yeti by NaverYeti by Naver is a search engine crawler operated by Naver.Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
YisouSpiderYisouSpider is a search engine crawler operated by Yisou.Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
ZoomInfoZoomInfo is a search engine crawler operated by ZoomInfo.Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
-
ZumBotZumBot is a web crawler operated by Zum that systematically indexes webpages and content to provide search results for Zum's Korean portal and search engine services.Search Engine CrawlerSearch Engine CrawlerSystematically scans and indexes web pages to include in search resultsSee More →
Security Scanners
-
AccessibleWebBotAccessibleWebBot is a web crawler that scans customer websites to monitor accessibility violations and ensure WCAG compliance as part of Accessible Web's RAMP monitoring …Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
AITrustRadarAITrustRadar is a security scanner that analyzes websites for vulnerabilities related to AI implementations and OWASP LLM security risks. It performs automated scans to d…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
AliyunSecBotAliyunSecBot is a security scanner operated by Alibaba, a major Chinese technology company. This bot crawls websites to scan for potential security vulnerabilities, threa…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Baidu-ADSBaidu-ADS is Baidu's Anti-DDoS Service proxy that filters and scrubs web traffic during detected DDoS attacks, routing sanitized requests back to target servers for prote…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
BlackVeil-Security-ScannerBlackVeil-Security-Scanner is a security scanning bot operated by BlackVeil that performs NIST-aligned security checks on domains, including DNS configuration, email auth…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CensysInspectCensysInspect is a security scanner operated by Censys that scans and indexes internet-connected devices and services. The bot systematically crawls websites and servers …Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CertChiefCertChief is a certificate monitoring bot that periodically crawls web properties to check SSL/TLS certificate configurations, expiration dates, and security status. It r…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
cf-qualys-scannercf-qualys-scanner is a cloud-based web application security scanner that provides automated crawling and vulnerability testing to identify security flaws including XSS, S…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Cloudflare-ValidatorCloudflare-Validator is a security scanner operated by Cloudflare that validates and verifies web properties as part of their content delivery network and security servic…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
cookie-maestrocookie-maestro is a GDPR compliance scanner that searches websites for all cookies placed in visitors' browsers to help ensure proper consent management and tracking cook…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CookiebotCookiebot is a compliance scanner that automatically crawls websites to detect and categorize cookies and tracking technologies, ensuring GDPR compliance by identifying d…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CookieHubCookieHub is a website crawler that scans websites to detect cookies in use, categorizes them, and verifies cookie consent compliance for privacy regulation adherence.Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CookieHubVerifyCookieHubVerify is a security scanner bot operated by CookieHub, a cookie consent management platform. This bot automatically scans websites to detect and categorize cook…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CookieYesbotCookieYesbot is an automated scanning bot used by CookieYes to verify the implementation and behavior of cookie consent banners and compliance configurations on websites …Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CybaaAgentCybaaAgent visits websites as part of Cybaa's security analysis service, gathering public information used to assess and monitor site risks.Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CyberConvoyScoutCyberConvoyScout is an internet scanner operated by CyberConvoy that records service banners, protocol handshakes, and TLS certificate data for threat intelligence and se…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
CyberOKInspectCyberOKInspect is a security scanner bot operated by CyberOK, a company that appears to perform security inspections and assessments of websites. The bot likely crawls we…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
cypex.ai/scanningCypex is a security scanner that crawls websites to identify vulnerabilities and security issues.Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
DetectifyDetectify is an application security testing platform that continuously scans web applications and attack surfaces for vulnerabilities, combining automated DAST methods w…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Digicert DCVDigiCert DCV (Domain Control Validation) is a security scanner bot operated by Cloudflare that validates domain ownership for SSL/TLS certificate issuance. It verifies th…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
DigiCert DCV BotDigiCert DCV Bot performs domain control validation checks to verify domain ownership during TLS/SSL certificate issuance and renewal processes for DigiCert certificates.Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
DomainScoresDomainScores scans public DNS records, email-authentication settings, TLS certificates, web security headers, and registration signals. Pragmatic Security uses these chec…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
DratabotDratabot monitors security posture and compliance controls for continuous governance, risk, and compliance management using Drata's AI-native platform.Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
ExpanseExpanse is a security scanner operated by Palo Alto Networks that continuously scans the global IPv4 address space multiple times per day. The scanner identifies and maps…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
FastDASTFastDAST is a dynamic application security testing scanner by Black Duck that identifies vulnerabilities in APIs and web applications during development and production ph…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
ForegenixForegenix security scanner performs passive vulnerability assessments and malware detection on eCommerce websites for banks and card brands to identify compromised mercha…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Google-InspectionToolGoogle-InspectionTool powers Search Console's URL Inspection tool and Rich Results Test, crawling pages to validate indexability, structured data markup, and search featu…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Google-SafetyGoogle-Safety is a specialized security crawler that performs abuse-specific scanning to detect malware and other security threats on publicly posted links across Google …Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Google-Trust-ServicesGoogle-Trust-Services is a certificate authority bot that helps build a safer Internet by providing transparent, trusted, and reliable TLS certificates. It crawls website…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
HardenizeHardenize is a security monitoring service that scans websites to assess their security configuration, including SSL/TLS certificates, network services, and other securit…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
InfrawatchInfrawatch is a security scanner that conducts internet measurement and security research to observe publicly accessible internet infrastructure. The bot performs routine…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
InternetMeasurementInternetMeasurement is a bot operated by Driftnet that scans and measures publicly exposed services on networks to provide network administrators with an external view of…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
ISSCyberRiskCrawlerISSCyberRiskCrawler is a security scanning bot operated by ISS, a governance and risk analytics company. It scans publicly accessible internet infrastructure to gather te…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
JumioJumio provides AI-driven digital identity verification and fraud detection services with biometric technology, document verification, and liveness detection for secure us…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
K7MLWCBotK7MLWCBot is a web crawler operated by K7 Computing, a cybersecurity and antivirus software company. This bot scans websites to identify malicious content and web-based t…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
KargoBot-ArtemisKargoBot-Artemis is Kargo's autonomous content verification bot that simulates iOS device user behavior to scan websites for content quality and suitability, ensuring bra…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
LegalMonsterLegalMonster is a privacy compliance monitoring service that scans customer websites for cookie and privacy legislation compliance, helping businesses meet data protectio…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →
-
Let's Encrypt validation serverThe Let's Encrypt validation server is a bot that verifies domain ownership as part of the process for issuing free SSL/TLS certificates. This bot visits websites to comp…Security ScannerSecurity ScannerScans websites for security vulnerabilities, threats, and configuration weaknessesSee More →