What is Applebot-Extended?

Applebot-Extended is an Apple robots.txt control token that lets publishers opt out of using Applebot-crawled content to train Apple foundation models. It does not crawl pages itself.

Category

AI Data Scraper
Downloads website content to include in datasets used for training AI models such as LLMs

Overview

Do you operate this agent? Contact us to suggest an update.
Operated By Apple
Source Official Website
Used for AI Model Training Yes
Affects AI Chat & Search Visibility Not directly
Applebot-Extended Should Not Be Visiting Websites
Applebot-Extended is a robots.txt control token that tells the operator how your data should be used. The actual crawling is done by other agents.

Should I Block Applebot-Extended?

Block Applebot-Extended if you want more control over whether your work is used for AI training. Allowing it may increase the chance that your brand appears in AI-generated answers, but either choice leaves traditional search rankings unchanged. For context, 20% of the top websites we track currently have robots.txt rules for Applebot-Extended.

How Do I Block Applebot-Extended Using Robots.txt?

Add this rule to your robots.txt file to block Applebot-Extended from accessing your website, or use Automatic Robots.txt to block all AI data scrapers at once. You can customize which pages are blocked by swapping out / for a different path.

User-agent: Applebot-Extended # https://knownagents.com/agents/applebot-extended
Disallow: /