Google and Rivals Back Universal Web Scraping Block for AI
Major tech companies including Google, OpenAI, and Anthropic have agreed to support a unified robots.txt directive to let publishers block AI data harvesting.
Latest stories, in-depth analysis & breaking updates
Major tech companies including Google, OpenAI, and Anthropic have agreed to support a unified robots.txt directive to let publishers block AI data harvesting.