À suivreGuide suivant
Loi TAKE IT DOWN et lois Deepfake non consensuelles
Société
GUIDE DE LA SOCIÉTÉ
Deepfake bullying is when students use AI tools to create fake but realistic images, video or audio of a classmate or teacher, often sexualized, and share them to humiliate or harass.
It matters because the images can be made in seconds from ordinary photos, spread quickly through group chats, and cause lasting harm, and sexual fakes of minors can be serious crimes.
Deepfake bullying became a widespread school problem once 'nudify' apps and image generators made it possible to turn a clothed social media photo into a fake nude with no technical skill. Reported cases include Almendralejo, Spain, in 2023, where AI nude images of more than twenty girls circulated, and schools in New Jersey and Beverly Hills, California, where students were disciplined or expelled over fakes of classmates. Victims are mostly girls, and the harm resembles having a real intimate image shared: shame, anxiety, avoiding school and fear the image will resurface. The first rule for adults is to protect the victim and preserve evidence without spreading the image. Realistic AI-generated sexual images of minors can count as child sexual abuse material under US federal law and in many other countries, so adults should not screenshot, download or forward them. Instead, record where it appeared, when, account names and who shared it, and report to police and, in the US, to NCMEC's CyberTipline. Take It Down lets families hash an image so platforms can block it; StopNCII.org offers a similar service for adults. In May 2025 the US enacted the TAKE IT DOWN Act, which criminalizes publishing nonconsensual intimate images including AI-generated ones and requires covered platforms to remove them after a valid request. Laws vary by state and country. Schools should treat these incidents as sexual harassment and abuse, not a technology prank. That means clear policies, trained staff, a fast reporting route, support for the targeted student, and proportionate consequences for those who made or shared the image. A common misconception is that labeling an image as fake removes the harm; victim accounts show it does not. Another is that deleting one post solves it, when copies often already exist elsewhere.
Les dommages catastrophiques et quotidiens causés par l’IA dépendent tous deux de la personne qui comprend les risques et qui peut agir.
Les connaissances du public et des professionnels déterminent si une politique de sécurité forte est politiquement possible.
Des explications claires réduisent la capture par le battage médiatique, les relations publiques en laboratoire et le théâtre d'éthique vague.
Legislatures in many countries are adding specific offenses for creating or sharing sexual deepfakes, and app stores and payment providers face growing pressure to remove nudify services. Schools are likely to include AI image abuse in digital citizenship and consent education. Technical fixes such as provenance labels and better platform matching will help but will not stop determined users with local tools. The lasting protections are fast reporting routes, trained staff, clear consequences and a culture where students report fakes instead of forwarding them.
A parent learns a nude fake of their daughter is circulating in a class group chat; they write down the date, chat name and who shared it without saving or forwarding the image, then contact the school and police.
A family uses NCMEC's Take It Down service to create a digital fingerprint of the fake image on their own device so participating platforms can detect and remove copies without the image being uploaded.
A middle school updates its code of conduct to name AI-generated sexual images explicitly as harassment, and holds an assembly explaining that 'it was just a joke' is not a defense.
A counselor meets the targeted student the same day, reassures them they did nothing wrong, and arranges a safe contact adult and schedule changes to avoid the students involved.
Traiter le risque existentiel comme de la science-fiction alors que les capacités s’accroissent.
Confondre sécurité des produits de surface et alignement sous haute autonomie.
Laisser le public non anglophone et non expert avec uniquement des sources de mauvaise qualité.
Séparez les dommages causés aux produits, leur mauvaise utilisation et les risques de perte de contrôle/désalignement.
Demandez quelles preuves pourraient changer votre point de vue sur les délais et la gravité.
Préférez les sources primaires et les évaluations concrètes aux allégations marketing.
Identifiez une voie d’action : carrière, politique, financement ou compétences – et pas seulement la sensibilisation.
Free newsletter
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Deepfake bullying is when students use AI tools to create fake but realistic images, video or audio of a classmate or teacher, often sexualized, and share them to humiliate or harass. It matters because the images can be made in seconds from ordinary photos, spread quickly through group chats, and cause lasting harm, and sexual fakes of minors can be serious crimes.
Sexual images of minors can be illegal to possess or share even when AI-generated, so adults should document details without spreading the file and report to police and the school.
The tool computes a hash locally and shares only that fingerprint with participating platforms, which match and remove copies.
The law covers AI-generated intimate images and requires covered platforms to remove them after a valid request.
Detectors degrade on messaging-app compression and new generators, so context like chat logs and who posted first is stronger evidence.
The harm mirrors real intimate image sharing, so schools should treat it as harassment with proper policies, support and consequences.
Continuez à apprendre
Plus de guides sélectionnés pour ce sujet
À suivreGuide suivant
Loi TAKE IT DOWN et lois Deepfake non consensuelles
Société