{"id":9184,"date":"2026-11-03T17:51:09","date_gmt":"2026-11-03T16:51:09","guid":{"rendered":"https:\/\/implementi.ai\/en\/2026\/11\/03\/openai-google-microsoft-and-anthropic-back-shared-ai-scraping-opt-out-standard\/"},"modified":"2026-11-03T17:51:09","modified_gmt":"2026-11-03T16:51:09","slug":"openai-google-microsoft-and-anthropic-back-shared-ai-scraping-opt-out-standard","status":"publish","type":"post","link":"https:\/\/implementi.ai\/es\/2026\/11\/03\/openai-google-microsoft-and-anthropic-back-shared-ai-scraping-opt-out-standard\/","title":{"rendered":"OpenAI, Google, Microsoft and Anthropic Back Shared AI Scraping Opt-Out Standard"},"content":{"rendered":"

OpenAI, Google, Microsoft, and Anthropic say they will adopt a shared standard intended to let publishers opt out of AI scraping through one website-level setting. The proposal affects website owners, developers of crawlers, and AI companies: instead of configuring preferences separately for each provider, a publisher could publish a common signal in its robots.txt<\/code> file.<\/p>\n

What the proposed AI scraping opt-out does<\/h2>\n

The signal is described as a shared \u201cpolicy token,\u201d proposed by Kevin Kelley, a technical lead for standards at Anthropic, within the Internet Engineering Task Force (IETF). It would sit alongside existing robots.txt<\/code> rules, which websites use to communicate whether web crawlers may access their content for purposes such as search indexing or archiving.<\/p>\n

According to the supplied report, the participating companies say they will adopt the new standard. The stated change is interoperability: publishers could express their AI-training preferences once for multiple AI companies, rather than maintain separate instructions for each provider.<\/p>\n

That does not establish that the system is already available, universally supported, or legally binding. The source material does not specify a rollout date, which AI products will read the signal first, whether the token can distinguish AI training from other forms of scraping, or how compliance will be checked.<\/p>\n

Why publishers and developers should care<\/h2>\n

For publishers, a common control could reduce the operational burden of managing crawler preferences across a changing AI market. A small business with a public documentation site, for example, might hypothetically want its pages indexed by conventional search engines while expressing a different preference about their use for AI training; the supplied material does not confirm whether the proposed token supports that exact combination.<\/p>\n

Developers and platform teams would need to treat the signal as part of crawler governance: document the site\u2019s policy, test the resulting robots.txt<\/code> output, and monitor which crawlers respect it. The main potential advantage is a shared convention rather than a series of provider-specific settings.<\/p>\n

What remains unresolved about the standard<\/h2>\n

The proposal\u2019s location in robots.txt<\/code> also highlights its limitation. Such files communicate a publisher\u2019s instructions, but the source does not describe technical enforcement, penalties for ignoring them, or remedies when content has already been collected. It likewise provides no detail on whether existing training datasets or previously scraped material would be affected.<\/p>\n

For now, publishers should not assume that adding a new token will immediately change how AI companies use their content. The practical next step is to follow the IETF proposal and provider documentation, then verify support before changing production crawler policies.<\/p>\n

Fuente:<\/strong> Reportaje original<\/a>. Este art\u00edculo incluye un contexto editorial independiente y un an\u00e1lisis pr\u00e1ctico.<\/p>\n

M\u00e1s informaci\u00f3n sobre la IA:<\/strong> Echa un vistazo a nuestra \u00daltimos art\u00edculos sobre automatizaci\u00f3n y tecnolog\u00eda de IA<\/a>, o echa un vistazo a soluciones de automatizaci\u00f3n listas para usar<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

OpenAI, Google, Microsoft, and Anthropic say they will adopt a shared standard intended to let publishers opt out of AI scraping through one website-level s<\/p>","protected":false},"author":2,"featured_media":9183,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[26],"tags":[],"class_list":["post-9184","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-automation"],"featured_image_src":"https:\/\/implementi.ai\/wp-content\/uploads\/2026\/11\/implementi-ai-news-20261103-175102-1024x576.jpg","blog_images":{"medium":"https:\/\/implementi.ai\/wp-content\/uploads\/2026\/11\/implementi-ai-news-20261103-175102-300x169.jpg","large":"https:\/\/implementi.ai\/wp-content\/uploads\/2026\/11\/implementi-ai-news-20261103-175102-1024x576.jpg"},"ams_acf":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/implementi.ai\/wp-content\/uploads\/2026\/11\/implementi-ai-news-20261103-175102.jpg","_links":{"self":[{"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/posts\/9184","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/comments?post=9184"}],"version-history":[{"count":0,"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/posts\/9184\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/media\/9183"}],"wp:attachment":[{"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/media?parent=9184"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/categories?post=9184"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/implementi.ai\/es\/wp-json\/wp\/v2\/tags?post=9184"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}