Cloudflare Launches AI Bot Blocker, Letting Millions of Websites Control and Charge for Content Scraping

Cloudflare, a major internet infrastructure company, is rolling out new technology that allows millions of websites to block AI bots from scraping their content without permission. Used by sites like Sky News and The Associated Press, the tool targets AI crawlers that collect data for training AI systems—often without compensating the original creators. Cloudflare plans to let websites charge AI firms for content access through a “Pay Per Crawl” model. This initiative responds to widespread concerns from publishers and content creators about unauthorized use of their work, sparking both tech innovation and calls for stronger legal protections. The move is seen as a turning point for digital rights management and the economic relationship between publishers and AI firms.

Read more