Skip to content

Glossary

AI training opt-out

Robots.txt rules that ask AI companies not to use your pages to train their models, without leaving their search results.

Training and search are separate switches. Blocking GPTBot, ClaudeBot, Google-Extended or Applebot-Extended opts out of model training (or, for Google-Extended, some grounding in Gemini apps), while their search bots and Google Search itself are controlled separately.

If you want to be recommended, never block the search bots: OAI-SearchBot, Claude-SearchBot, PerplexityBot, Googlebot and Bingbot.

Go deeperrobots.txt rules for AI crawlers: what to allow and what to blockRead the guide

Sources

All terms

Be the business AI recommends.

Pick a plan, connect your site and let CiteMagnet fix what's in the way. Cancel any time.