社团指南

Opting Out of AI Training Datasets

Creators can reduce future use of their work for AI training by blocking AI crawlers in robots.txt, turning off training permissions in platform settings, and registering with opt-out services, and can check some public datasets with search tools.

  • 4 分钟阅读
  • 最后更新
在本页4 分钟阅读
  1. 概述
  2. 深入探讨
  3. 战略影响
  4. The Future of Opting Out of AI Training Datasets
  5. 现实世界的实施
  6. 风险与防护栏
  7. 实施路线图
  8. 不断探索
  9. 常见问题

概述

These measures mostly affect future collection by companies that choose to respect them; they do not remove work from models already trained.

深入探讨

Most large AI models are trained on material collected from the web. Common Crawl publishes huge crawls of the public internet, and image datasets such as LAION-5B, with about 5.85 billion image and caption pairs, were built by filtering them. LAION distributes links and captions rather than image files, but models trained with it downloaded the images from those links. To check whether your work appears, Spawning's Have I Been Trained lets you search LAION datasets by text or image. It covers only the datasets it indexes; there is no way to search the private data many companies use. The main prevention tools are: robots.txt. Many AI companies publish crawler names that sites can block, including GPTBot (OpenAI), ClaudeBot (Anthropic), CCBot (Common Crawl), Applebot-Extended (Apple) and Google-Extended, which controls use in Google's Gemini models without removing a site from Google Search. Some hosts and CDNs, such as Cloudflare, offer one-click AI crawler blocking. Platform settings. Services like LinkedIn and X have offered settings controlling training on user content, and Meta has offered objection forms in regions with stronger data protection law. Art sites such as DeviantArt and ArtStation introduced NoAI tags. Registries and legal reservations. Spawning's Do Not Train registry records opt-outs that some companies, including Stability AI for certain models, said they would honor. In the EU, the 2019 copyright directive allows rights holders to reserve text and data mining rights in machine-readable form, and the EU AI Act requires general-purpose model providers to respect such reservations. The limits are important. robots.txt is voluntary and not enforcement. Opt-outs are not retroactive, and trained models do not forget. Copies of your work reposted elsewhere are not covered by your site's rules. Blocking crawlers can also reduce visibility in AI-powered search. Opting out lowers exposure; it does not guarantee exclusion.

战略影响

风险与安全

灾难性和日常的人工智能危害都取决于谁了解风险以及谁能够采取行动。

更清晰的判决

公众和专业素养决定强有力的安全政策在政治上是否可行。

打破炒作

清晰的解释可以减少炒作、实验室公关和模糊道德剧场的影响。

The Future of Opting Out of AI Training Datasets

Pressure is growing for opt-out signals that are standardized and legally meaningful rather than scattered across crawler names and platform menus. Standards bodies and industry groups are working on shared vocabularies for AI usage preferences, and EU rules are pushing providers to document how they respect reservations. Licensing deals between AI companies and publishers suggest a market for consented data is forming, though mostly for large rights holders. Lawsuits over training on copyrighted work may change the default rules in some countries. For now, individual creators should treat opt-outs as partial protection and check settings periodically, since platforms change them.

现实世界的实施

An illustrator searches her portfolio images on Have I Been Trained, finds several in LAION-5B, and adds them to Spawning's Do Not Train registry, knowing this only binds companies that honor it.

A photographer who runs his own site adds robots.txt rules disallowing GPTBot, CCBot, ClaudeBot and Google-Extended, while leaving Googlebot allowed so his pages still appear in search results.

A writer on LinkedIn switches off the setting that allows her data to be used to train generative AI models and notes that this does not undo past use.

A small publisher in the EU adds a machine-readable reservation of text and data mining rights to its site and terms of use, relying on the EU copyright exception that lets rights holders opt out.

风险与防护栏

  • 将存在风险视为科幻小说,同时能力复合。

  • 混淆了表面产品安全与高度自治下的对准。

  • 只给非英语和非专业观众留下低质量的资源。

实施路线图

  1. 单独的产品危害、误用和失控/失调风险。

  2. 询问哪些证据会改变您对时间表和严重性的看法。

  3. 比起营销主张,更喜欢主要来源和具体评估。

  4. 确定一条行动路径:职业、政策、资金或技能——而不仅仅是意识。

不断探索

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Opting Out of AI Training Datasets quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

开始测验

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

常见问题

What is Opting Out of AI Training Datasets?

Creators can reduce future use of their work for AI training by blocking AI crawlers in robots.txt, turning off training permissions in platform settings, and registering with opt-out services, and can check some public datasets with search tools. These measures mostly affect future collection by companies that choose to respect them; they do not remove work from models already trained.

What does the LAION-5B dataset actually distribute?

LAION provides URLs and captions. Model trainers downloaded the images from those links.

What does blocking Google-Extended in robots.txt do?

Google-Extended is a control token for AI training use. Blocking it leaves Search indexing untouched.

What is the main limitation of opting out after a model is trained?

Opt-outs affect future collection by companies that honor them. Past training is not undone.

Why does blocking crawlers in your own site's robots.txt not fully protect your work?

robots.txt is a request that well-behaved crawlers follow, and it only applies to the site that publishes it.

What does Spawning's Have I Been Trained tool let you do?

It searches the datasets it indexes. It cannot see private training data used by many companies.