Block Bad Bots on Your WordPress Website

Step 1: Install the Plugin

• Navigate to the Known Agents Projects page and open your project
• Copy your access token from the Settings page
• Log in to your website's WordPress dashboard
• Click Plugins in the sidebar
• Search for Known Agents (Plugin Directory)
• Click Install Now
• Click Activate

Step 2: Enforce Your Robots.txt Rules

• Click Known Agents in the sidebar
• Paste in your access token
• Under Set Up Automatic Robots.txt, select the agent types you want to block
• Check the Forcefully Block Misbehaving Bots box
• Click Save Changes

Agents that ignore your robots.txt rules will receive an HTTP 403 Forbidden response, blocking access to your website's content. Make sure any caching you're doing respects the standard Cache-Control HTTP header.