What is MetaInspector?

Often yes. MetaInspector extracts content at scale, and scrapers in this category commonly republish or resell what they take. There is rarely an upside for the website being scraped, and copies of your content elsewhere can compete with your own pages in search. Almost none of the top websites we track have robots.txt rules for MetaInspector right now.

Yes. MetaInspector is expected to follow robots.txt rules, so a disallow rule is the right first move. Automatic Robots.txt adds and maintains that rule for you, and Agent Analytics confirms MetaInspector actually follows it.

Assume MetaInspector will try. Scrapers routinely ignore robots.txt, and some go after paywalled or gated content when it has value. Real authentication stops most of them. Politeness conventions stop almost none of them.

Your site has data MetaInspector's operator wants, like prices, listings, contact details, or articles. Scrapers target sites deliberately, so repeated visits mean your content specifically is the goal.

Agent Analytics tracks MetaInspector visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user agent string contains "MetaInspector". Look for fast sequential requests across many pages. Keep in mind that MetaInspector doesn't publish a verification method, so any client can claim its user agent string and a log match is a hint rather than proof.