Ubuyobozi bwa tekiniki

Gufata mu mutwe muri Diffusion Models

Moderi yerekana amashusho ubusanzwe itanga amashusho mashya, ariko ubushakashatsi bwerekanye ko rimwe na rimwe bashobora kubyara amashusho yihariye yamahugurwa hafi ya yose, cyane cyane amashusho yagaragaye inshuro nyinshi mumibare yamahugurwa.

Umva iki gitaboAI-byavuzwe · ~3 min

Kuriyi page3 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Igihe kizaza cyo gufata mu mutwe muri Diffusion Models
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Ibi byitwa gufata mu mutwe. Nibyingenzi kuburenganzira, kuberako hafi-kopi yumurimo urinzwe irashobora kuva mubyitegererezo, no kubanga, kuko ifoto yumuntu nyawe cyangwa scan yubuvuzi irashobora gusubirwamo.

Kwibira cyane

A diffusion model learns to reverse a noising process: during training it sees images with noise added and learns to predict and remove that noise. If it generalizes well, it learns the statistics of images in general and produces new combinations. But neural networks can also fit individual examples, and when one image appears hundreds or thousands of times in the data, the cheapest way to reduce training loss on it is to store it. The key evidence comes from Carlini and colleagues' 2023 paper 'Extracting Training Data from Diffusion Models'. They generated many images for captions of the most duplicated training images and flagged outputs that were extremely close to a training image. They extracted over a hundred near-identical copies from Stable Diffusion, including photos of identifiable people, and found higher memorization rates in Google's Imagen. Separately, Somepalli and colleagues (2022-2023) showed that Stable Diffusion outputs frequently copied parts or layouts of training images, and linked copying to duplicated images and highly specific captions. Three misconceptions are worth correcting. First, memorization is not the model's normal behavior: extracted copies are rare relative to all generations. Second, rare does not mean harmless, because a determined user can target the images most likely to be memorized. Third, memorization is not only exact pixel copying; models can reproduce characters, logos, watermarks and distinctive compositions. This evidence has featured in legal debates, including lawsuits such as Getty Images v. Stability AI and Andersen v. Stability AI, although how courts treat model training and outputs is still being worked out and varies by country. For privacy, the concern is sharper in small fine-tuning datasets, such as medical or personal photos, where each example has more influence.

Gushyira mu bikorwa Isi

Abashakashatsi batanga icyitegererezo gifite ibisobanuro nyabyo byerekana amashusho yigana cyane hanyuma bakagarura ibisohoka hafi ya pigiseli-isa nifoto yumwimerere.

Igishushanyo mbonera gisaba uburyo bwo gushushanya buzwi kandi yakira ishusho yandukura ibihimbano nibisobanuro byubuhanzi bumwe aho kuba igishya.

Imashini itanga amashusho yatojwe kumashusho y'urubuga rimwe na rimwe itanga verisiyo igoretse y’amazi y’ikigo cy’imigabane, yerekana uburyo yakuyemo amashusho yatanzwe.

Itsinda ryibitaro ritegura neza uburyo bwo gukwirakwiza ku gipimo gito cy’isuzuma ry’abarwayi niba icyitegererezo gishobora gusohora hafi-kopi ya scan mbere yuko kugabana byemewe.

Igihe kizaza cyo gufata mu mutwe muri Diffusion Models

Kugabanuka no gusohora ibisa bihinduka imyitozo isanzwe kubateza imbere bashinzwe, kandi ubushakashatsi burakomeza mugushakisha ibimenyetso byafashwe mumutwe mugihe cyo gufata umwanzuro. Ibanga ritandukanye rishobora kuba ingirakamaro kuri domaine zoroshye nko gufata amashusho yubuvuzi, nubwo ibicuruzwa byiza bisigaye. Ishusho yemewe ntabwo ihagaze neza: inkiko zo mubihugu bitandukanye zirimo gusuzuma niba amahugurwa nibisohoka bibangamira uburenganzira, kandi ibisubizo birashobora gutandukana. Abashinzwe iterambere barashobora guhura nigitutu cyinshi kugirango bandike amakuru yamakuru yatanzwe kandi berekane uburyo bapima kandi bagabanya kugarura.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Fata gufata mu mutwe muri Diffusion Models ikibazo

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Gufata mu mutwe ni iki muri Moderi ya Diffusion?

Moderi yerekana amashusho ubusanzwe itanga amashusho mashya, ariko ubushakashatsi bwerekanye ko rimwe na rimwe bashobora kubyara amashusho yihariye yamahugurwa hafi ya yose, cyane cyane amashusho yagaragaye inshuro nyinshi mumibare yamahugurwa. Ibi byitwa gufata mu mutwe. Nibyingenzi kuburenganzira, kuberako hafi-kopi yumurimo urinzwe irashobora kuva mubyitegererezo, no kubanga, kuko ifoto yumuntu nyawe cyangwa scan yubuvuzi irashobora gusubirwamo.

Gufata mu mutwe ni ubuhe buryo bwo gukwirakwiza?

Gufata mu mutwe bisobanura ibisubizo biri hafi-kopi yamashusho yihariye yo guhugura, kuruta amashusho mashya.

Kuki amakuru yigana yongera gufata mu mutwe?

Gusubiramo kenshi kumashusho amwe bituma bikwiranye nurugero nyarwo inzira nziza yo kugabanya igihombo.

Ni iki impapuro za Carlini na bagenzi be 2023 zerekanye?

Bakuyemo kopi zirenga ijana hafi ya Stable Diffusion, harimo amafoto yabantu bamenyekana, basanga ibiciro biri hejuru muri Imagen.

Nigute igitero cyo gukuramo cyagaragaje amashusho ashobora gufata mu mutwe?

Ishusho yafashwe mu mutwe igaragara buri gihe hatitawe ku mbuto, bityo rero uduce twinshi twa hafi-dusohoka ibendera ry'abakandida.

Ni ayahe magambo yerekeye gufata mu mutwe ari ukuri?

Amakopi yakuweho ni gake ugereranije nibisohoka byose, ariko abateye bashobora kwibanda kumashusho ashobora kuba yafashwe mumutwe.