Agent Directory
The definitive guide to every known AI agent, crawler, scraper, and other bot on the internet, updated daily.
Security Scanners
Dratabot
Dratabot monitors security posture and compliance controls for continuous governance, risk, and compliance management using Drata's AI-native platform.
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Expanse
Expanse is a security scanner operated by Palo Alto Networks that continuously scans the global IPv4 address space multiple times per day. The scanner identifies and maps…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
FastDAST
FastDAST is a dynamic application security testing scanner by Black Duck that identifies vulnerabilities in APIs and web applications during development and production ph…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Foregenix
Foregenix security scanner performs passive vulnerability assessments and malware detection on eCommerce websites for banks and card brands to identify compromised mercha…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Google-InspectionTool
Google-InspectionTool powers Search Console's URL Inspection tool and Rich Results Test, crawling pages to validate indexability, structured data markup, and search featu…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Google-Safety
Google-Safety is a specialized security crawler that performs abuse-specific scanning to detect malware and other security threats on publicly posted links across Google …
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Google-Trust-Services
Google-Trust-Services is a certificate authority bot that helps build a safer Internet by providing transparent, trusted, and reliable TLS certificates. It crawls website…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Hardenize
Hardenize is a security monitoring service that scans websites to assess their security configuration, including SSL/TLS certificates, network services, and other securit…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Infrawatch
Infrawatch is a security scanner that conducts internet measurement and security research to observe publicly accessible internet infrastructure. The bot performs routine…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
InternetMeasurement
InternetMeasurement is a bot operated by Driftnet that scans and measures publicly exposed services on networks to provide network administrators with an external view of…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
ISSCyberRiskCrawler
ISSCyberRiskCrawler is a security scanning bot operated by ISS, a governance and risk analytics company. It scans publicly accessible internet infrastructure to gather te…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Jumio
Jumio provides AI-driven digital identity verification and fraud detection services with biometric technology, document verification, and liveness detection for secure us…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
K7MLWCBot
K7MLWCBot is a web crawler operated by K7 Computing, a cybersecurity and antivirus software company. This bot scans websites to identify malicious content and web-based t…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
KargoBot-Artemis
KargoBot-Artemis is Kargo's autonomous content verification bot that simulates iOS device user behavior to scan websites for content quality and suitability, ensuring bra…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
LegalMonster
LegalMonster is a privacy compliance monitoring service that scans customer websites for cookie and privacy legislation compliance, helping businesses meet data protectio…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Let's Encrypt validation server
The Let's Encrypt validation server is a bot that verifies domain ownership as part of the process for issuing free SSL/TLS certificates. This bot visits websites to comp…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Netcraft SSL Server Survey
Netcraft SSL Server Survey is a security scanner operated by Netcraft, a cybersecurity and digital risk protection company. This bot scans websites to collect SSL/TLS cer…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Nmap Scripting Engine
Nmap Scripting Engine is a component of Nmap, a free and open source network discovery and security auditing tool. It scans networks and hosts to determine available serv…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Observer
Observer is a web security crawler that scans websites to identify third-party risks, security vulnerabilities, and performance issues. It detects compromised external re…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Odin
Odin is a web crawler operated by ODIN, an internet scanning search engine platform. The bot scans websites as part of indexing operations that power searches across vari…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
OneTrust
OneTrust is a privacy compliance crawler that scans customer websites to identify and categorize cookies, tracking technologies, forms, tags, and storage mechanisms for p…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
ProjectShield-UrlCheck
ProjectShield-UrlCheck is a security scanner that monitors websites protected by Google's Project Shield service, checking for malicious traffic and DDoS attacks to ensur…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Sansec Security Monitor
Sansec Security Monitor is a specialized e-commerce security scanner that monitors online stores for malware, vulnerabilities, and digital skimming attacks, providing rea…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
SecurityHeaders
SecurityHeaders is a free security scanning service that analyzes HTTP security headers on websites, providing grades and recommendations to improve web security posture …
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
SiteLockSpider
SiteLockSpider is SiteLock's web scanning service that crawls websites to detect malware, malicious code, and security vulnerabilities for website protection.
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Software Security Research
Software Security Research is an academic research crawler operated by the Chair for Software Security at Ruhr University Bochum in Germany. This bot performs HTTP and HT…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
SSL Labs
SSL Labs is Qualys' free online SSL/TLS security testing service that performs deep analysis of SSL web server configurations on the public Internet to identify security …
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Sucuri
Sucuri crawls websites to detect malware, security vulnerabilities, and blacklist status as part of its cloud-based website security platform and malware removal services…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
TermlyBot
TermlyBot is Termly's web scanner that analyzes websites for legal compliance, privacy policy requirements, and cookie usage to ensure regulatory adherence.
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
TwinWaveScanner
TwinWaveScanner (Splunk Attack Analyzer) uses headless Chrome browsers to analyze URLs for malicious content, performing automated threat analysis with comprehensive DOM,…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Usercentricsbot
Usercentricsbot is a security scanner operated by Usercentrics that analyzes websites for data protection and privacy compliance issues. The bot is part of their DPS (Dat…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
Verispider
Verispider is a security scanning bot that analyzes websites for spam and security threats, utilizing Project Honeypot IP intelligence for threat assessment.
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
visionheight.com/scan
visionheight.com/scan is a security scanner.
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
WTotem
WTotem is a security monitoring bot that scans websites and web applications to detect malware, vulnerabilities, and other security threats.
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
WTotemBot
WTotemBot is a security scanner operated by WebTotem, a website security monitoring service that provides firewall protection, antivirus scanning, and vulnerability manag…
Security Scanner
Security Scanner
Scans websites for security vulnerabilities, threats, and configuration weaknesses
See More →
SEO Crawlers
aa
aa is a web crawler used by Agency Analytics for collecting SEO data and analyzing website performance to help marketing agencies generate client reports.
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Ahrefs Site Audit
Ahrefs Site Audit is an SEO crawler operated by Ahrefs.
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
AhrefsBot
AhrefsBot is Ahrefs' web crawler that powers both the Ahrefs marketing intelligence platform and Yep search engine, constantly crawling the web to build a comprehensive l…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
AhrefsSiteAudit
AhrefsSiteAudit is a technical SEO crawler that analyzes websites to identify and flag over 170 technical and on-page SEO issues, providing detailed recommendations and p…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Attracta
Attracta is a web crawler that analyzes website content and structure to provide SEO optimization services, including link building strategies and search engine ranking i…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Audisto Crawler
Audisto Crawler systematically fetches all accessible URLs of websites to provide comprehensive site auditing and monitoring services for SEO and technical analysis.
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Barkrowler
Barkrowler is an SEO web crawler operated by Babbar that analyzes websites to identify page popularity, topical relevance, and authority metrics for search engine optimiz…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
BLEXBot
BLEXBot is WebMeUp's web crawler that builds the world's freshest backlink index for SEO PowerSuite Link Explorer, providing comprehensive backlink data for SEO analysis …
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
botify
botify's SiteCrawler analyzes website structure and content like a search engine, giving enterprise SEO teams detailed insights into how their sites are crawled and index…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
BrightEdge Crawler
BrightEdge Crawler powers the Autopilot SEO automation tool, crawling customer websites to analyze internal linking opportunities and identify images needing optimization…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
CaliberBot
CaliberBot is an SEO crawler operated by Conductor.
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Caliperbot
Caliperbot is a web crawler that analyzes website content and technical features for Conductor's SEO intelligence platform, extracting HTML elements and data to power con…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
ClarityBot
ClarityBot is an SEO crawler operated by seoClarity, a search engine optimization platform. This bot crawls websites to collect data for SEO analysis and insights, helpin…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Clearscopebot
Clearscopebot crawls content for Clearscope, an AI-powered SEO content optimization platform by Mushi Labs. Analyzes top-performing content to provide keyword recommendat…
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →
Cloudflare Custom Hostname Verification
Cloudflare Custom Hostname Verification is an SEO crawler.
SEO Crawler
SEO Crawler
Analyzes website structure and content to identify SEO improvement opportunities
See More →