Tech Giants Agree on Unified AI Content Blocking System

WASHINGTON: (News Desk) – OpenAI, Google, Microsoft and Anthropic have pledged to introduce a common system that will allow news publishers and other website owners to prevent their content from being used to train artificial intelligence (AI) models. The initiative comes amid growing concerns among media organisations over unauthorised content scraping and ongoing legal disputes with major technology companies.

Currently, publishers must use separate instructions to block individual bots that crawl websites and collect online material. Under the proposed system, website owners will be able to issue a single standardised instruction that can be recognised and followed by AI companies adopting the protocol.

However, the new mechanism will not become fully operational immediately. Microsoft plans to introduce it from February 1, 2027, while Google expects to implement it sometime during 2027. OpenAI has said the system will be rolled out in the coming months, whereas Anthropic confirmed that it has already begun implementation.

The move comes as publishers increasingly struggle to protect their material from automated bots that collect articles and other online content for AI training. Several media organisations have raised concerns about the use of their copyrighted material without permission or financial compensation, with some pursuing legal action.

In December 2023, The New York Times filed a lawsuit against OpenAI and Microsoft, accusing the companies of using millions of its articles without authorisation or payment to train ChatGPT. Both companies have defended their position by invoking the copyright doctrine of fair use.

Meanwhile, internet infrastructure company Cloudflare has automatically blocked AI bots on newly added customer websites since July 2025. Another initiative, known as Really Simple Licensing, already provides a framework through which publishers can charge automated bots for accessing their online content.

Microsoft clarified in a blog post that the proposed setting will apply only to future AI model training and will not prevent bots from crawling websites for other purposes. Content collection will also remain permitted by default unless publishers change their settings to opt out.

Both Microsoft and Google have cautioned that preventing AI companies from using website content for training could reduce the likelihood of publishers’ material appearing in AI-powered applications and services.

Meta also expressed support for the initiative. Company spokesperson Andy Stone said on X that establishing a common signal to communicate publishers’ preferences across multiple AI providers would be an important development. He added that Meta looked forward to working with other AI companies on industry-wide standards and their implementation.