One Line of robots.txt Now Blocks AI Training — Here's What It Actually Does
Google, Anthropic, OpenAI, and Microsoft will honor a single robots.txt token that opts your site out of generative AI training. Here's the snippet, the staggered rollout dates, and the limits nobody mentions.