A continuaciónSiguiente guía
AI Voice Cloning Scams and How to Protect Yourself
sociedad
GUÍA de sociedad
Glaze and Nightshade are free tools from the University of Chicago that add small, carefully optimized changes to artwork so AI models misread it: Glaze tries to stop models from copying an artist's style, and Nightshade tries to poison training data so models learn wrong associations.
They give artists some leverage against unauthorized training, but researchers have shown they can be weakened or removed, so they are a deterrent rather than a guarantee.
Both tools come from the SAND Lab at the University of Chicago, led by Ben Zhao. Glaze was released in 2023 and Nightshade in January 2024, and both are free. Glaze also has a web version, WebGlaze, for artists without powerful computers. Glaze addresses style mimicry. Someone can fine-tune an image model on a few dozen pieces by one artist, then produce unlimited work in that style. Glaze adds a perturbation, a pattern of small pixel changes, that makes the artwork appear to a model's image encoder as though it were in a different style. A model fine-tuned on glazed images learns the wrong style, while a person sees little change. Nightshade is offensive rather than defensive. It targets training on scraped data. A shaded image of a dog is changed so a model perceives features of something else, such as a cat. Because each concept appears in relatively few training images compared with the whole dataset, the researchers argued that a modest number of poisoned samples could make a model respond to "dog" with distorted results. The aim is to raise the cost of scraping without permission. How well do they work? The perturbations are tuned against specific model components, and that is their weakness. A 2024 study by researchers at ETH Zurich and Google DeepMind found that simple methods, such as noisy upscaling, could remove Glaze-style protections enough for mimicry to succeed. Later work, including LightShed in 2025, trained detectors to spot and strip poisoning perturbations. The Glaze team has disputed some findings and updated its tools. The key misconception is that protection is permanent. An image published today cannot be updated later, while attackers and models keep changing. The tools can also leave visible artifacts, especially at high intensity.
Los daños catastróficos y cotidianos de la IA dependen de quién comprende los riesgos y quién puede actuar.
La alfabetización pública y profesional determina si es políticamente posible una política de seguridad sólida.
Las explicaciones claras reducen la captación por la exageración, las relaciones públicas de laboratorio y el vago teatro de ética.
The contest between perturbation tools and removal methods resembles other adversarial arms races, and research so far suggests defenders are at a structural disadvantage because published images are fixed while attacks keep improving. Glaze and Nightshade are still valued by many artists as a way to raise the cost of misuse and signal non-consent. Longer-term protection is more likely to come from a combination of legal rules on training data, licensing arrangements, provenance standards and platform policies. Artists should use these tools with realistic expectations and keep other measures in place.
A digital painter runs each new piece through Glaze before posting it, so someone who fine-tunes a LoRA on her portfolio gets outputs that do not match her brushwork and palette.
An illustrator applies Nightshade to images of dragons she posts publicly, aiming to make scraped copies teach a model visual features of an unrelated concept.
An artist compares Glaze intensity settings and chooses a lower level for a soft watercolor piece because higher settings left visible artifacts in flat color areas.
A small art community discusses research showing upscaling can strip protections and decides to combine Glaze with opt-out registries and platform settings rather than rely on it alone.
Tratar el riesgo existencial como ciencia ficción mientras que la capacidad se agrava.
Confundir la seguridad del producto superficial con la alineación en condiciones de alta autonomía.
Dejando a las audiencias que no hablan inglés ni a expertos solo con fuentes de baja calidad.
Separe los riesgos de daños al producto, mal uso y pérdida de control/desalineación.
Pregunte qué evidencia cambiaría su opinión sobre los plazos y la gravedad.
Prefiera fuentes primarias y evaluaciones concretas a afirmaciones de marketing.
Identifique un camino de acción: carrera, política, financiamiento o habilidades, no solo concientización.
Free newsletter
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Glaze and Nightshade are free tools from the University of Chicago that add small, carefully optimized changes to artwork so AI models misread it: Glaze tries to stop models from copying an artist's style, and Nightshade tries to poison training data so models learn wrong associations. They give artists some leverage against unauthorized training, but researchers have shown they can be weakened or removed, so they are a deterrent rather than a guarantee.
Glaze targets people who fine-tune models on an artist's images to reproduce that style.
Glaze is defensive, protecting one artist's style. Nightshade is offensive, aiming to corrupt what a model learns from scraped images.
Glaze moves the image's feature representation toward a decoy style so fine-tuning learns that style instead.
The optimization limits how different the image looks to people while maximizing how different it looks to the model.
The study showed that inexpensive preprocessing could undo the protections, allowing style mimicry to succeed.
sigue aprendiendo
Más guías seleccionadas para este tema.
A continuaciónSiguiente guía
AI Voice Cloning Scams and How to Protect Yourself
sociedad