Agent Directory

Archivers

• Archive-It
  Archive-It is a web archiving crawler operated by Internet Archive that preserves copies of web pages for long-term digital preservation and historical record-keeping. It…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• archive.org_bot
  archive.org_bot is the Internet Archive's web crawler for the Wayback Machine, systematically crawling and preserving publicly accessible web pages for historical record …
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• Arquivo-web-crawler
  Arquivo-web-crawler is the Portuguese web archive's bot that systematically crawls and preserves Portuguese websites for historical research, creating a comprehensive dig…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• Authory
  Authory is an automated content archiving crawler that systematically searches for and backs up published articles, podcasts, and videos by journalists and content creato…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• bl.uk_lddc_bot
  bl.uk_lddc_bot is operated by the British Library as part of their legal deposit web archiving program, which collects and preserves UK web content for the national archi…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• bne.es_bot
  bne.es_bot is an archiver.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• bnf.fr_bot
  bnf.fr_bot is the official web crawler of the Bibliothèque nationale de France (BNF), systematically collecting and archiving digital content from French websites to pres…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• CUCH.org Archive Bot
  CUCH.org Archive Bot is a web crawler that archives web content on behalf of C U Cyber History.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• heritrix
  heritrix is an archiver operated by Internet Archive.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• ia_archiver
  ia_archiver is an archiver operated by Internet Archive.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• ia_archiver-web.archive.org
  ia_archiver-web.archive.org is an archiver operated by Internet Archive.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• IABot
  IABot (InternetArchiveBot) is a Wikipedia bot operated by the Internet Archive that combats link rot by finding dead links on Wikipedia articles and adding archived versi…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• Internet Archive
  Internet Archive is an archiver operated by Internet Archive.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• mirrorweb
  mirrorweb is a web archiving crawler that captures websites in their entirety, including dynamic content and interactive elements, creating tamper-proof WARC archives for…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• netarkivindsamling
  netarkivindsamling is a web crawler operated by the Royal Danish Library that collects Danish internet content according to the Danish Legal Deposit Act for preservation …
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• Nicecrawler
  Nicecrawler is an archiver operated by NiceCrawler.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• OddlyBot
  OddlyBot crawls public web pages to create a verifiable record of what they published and when.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• SmarshBot
  SmarshBot is an archiving bot operated by Smarsh that crawls and captures web content for compliance management and regulatory recordkeeping purposes. Organizations use t…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• special_archiver
  special_archiver is a web crawler operated by Internet Archive as part of their Archive-It service, which creates and preserves collections of web content. This bot visit…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• Turnitin
  Turnitin crawler gathers web content to build a comprehensive database for plagiarism detection services, comparing student papers against internet content for academic i…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• XY-Archive-Compliance
  XY-Archive-Compliance creates website archives to help customers meet regulatory and legal compliance requirements for data retention and historical website preservation.
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →
• XY-Archive-Compliance-Archiver
  XY-Archive-Compliance-Archiver is an archiving bot operated by XY Planning Network, a membership organization for fee-only financial advisors. This bot archives web conte…
  Archiver

  Archiver

  Captures and stores historical website snapshots for long-term digital preservation

  See More →