Your site, your rules: new AI traffic options for all customers

My take: Starting today, if you have a new site on Cloudflare or are on the free plan, AI training bots and autonomous agents are blocked by default from crawling your ad-bearing pages. Cloudflare split crawlers into three categories: Search, Agent, and Training. The last two are now off by default on ad-supported pages.

For content creators, this is one of the most direct decisions a major infrastructure company has made to change how AI accesses the web. For years, models trained freely on millions of articles, posts, and pages made by real people. This policy doesn't stop that entirely, but it puts control back in the creator's hands and opens the door to real compensation through the new Pay Per Use program.

If you have a site published, now is a good time to check which AI crawlers have access to your content. The question is: how much is your creative work worth, and who is actually paying for it?