Ubuyobozi bwa tekiniki

InfoNCE na SimCLR Intego

InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka InfoNCE na SimCLR Intego
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

SimCLR is a landmark framework that used this loss to learn powerful image representations from unlabeled data, rivaling supervised pretraining.

Kwibira cyane

InfoNCE (Urusaku-Itandukaniro Rigereranya Kumakuru Yamakuru) itoza kodegisi kugirango ikibazo nibyiza byukuri bifite amanota asa cyane kuruta ikibazo nibibi byinshi. Nubusanzwe ni softmax cross-entropy hejuru yamanota asa: kuri ankeri, ibyiza bigomba gutsinda ibibi. SimCLR (2020) yakoresheje ibi kumashusho: fata ishusho imwe, shyiramo ibyongeweho bibiri bidasanzwe kugirango ukore couple nziza, ukoreshe byombi ukoresheje kodegisi isangiwe wongeyeho umutwe wa projection, kandi ukoreshe ubushyuhe busanzwe bwapimye cross-entropy (NT-Xent, impinduka ya InfoNCE) kuburyo ibitekerezo byombi byiyongereye bikurura mugihe andi mashusho yose mugice akora nkibibi. SimCLR yerekanye ko kongera amakuru gukomeye, umutwe uteganijwe utagira umurongo, ingano nini yicyiciro, hamwe nubushyuhe bwahujwe hamwe reka reka moderi yiyobora ihure nabashinzwe kugenzura kuri ImageNet - nta kirango na kimwe mugihe cyo kwitegura.

Gushyira mu bikorwa Isi

SimCLR yerekana amashusho ya kodegisi kumafoto atanditseho, hanyuma ugahuza neza kumurongo muto washyizweho kugirango ushyirwe mubikorwa.

KANDA ukoresheje intego ya InfoNCE kugirango uhuze amashusho hamwe naya magambo, ashoboza ishusho ya zeru.

Kubaka amashusho / gushakisha aho amashusho asa yicaye hafi mumwanya wize wo gushira.

Kwiyobora wenyine kwitegura amashusho yubuvuzi cyangwa satelite aho ibirango ari bike ariko amakuru yibanze ni menshi.

Kazoza ka InfoNCE na SimCLR Intego

Intego zinyuranye zikwirakwira kure ya SimCLR: CLIP ihuza amashusho ninyandiko ukoresheje InfoNCE muburyo bumwe, kandi igihombo kimwe gitwara amajwi, amashusho, hamwe no kugarura ibintu. Ubushakashatsi ubu bugabanya kwishingikiriza kumatsinda manini nibibi byinshi binyuze muri banki yibuka (MoCo), cyangwa ikuraho ibibi byuzuye (BYOL, SimSiam, DINO). Witege ko uzakomeza kuvanga itandukaniro, gusibanganya, hamwe na masike-yerekana icyitegererezo, hamwe na multimodal ihuza (inyandiko, ishusho, amajwi) nkumupaka wiganjemo icyitegererezo.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the InfoNCE and SimCLR Objectives quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is InfoNCE and SimCLR Objectives?

InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya. SimCLR ni urwego rwibanze rwakoresheje iki gihombo kugirango wige amashusho akomeye uhereye kumibare itanditse, irwanya kugenzurwa.

Niki intego ya InfoNCE ishishikariza icyitegererezo gukora?

InfoNCE ni softmax hejuru yibyo bisa bihembera byinshi bisa nibyiza kandi byiza bisa nibibi.

Muri SimCLR, nigute habaho couple nziza?

SimCLR ibyara couple nziza uhereye kubintu bibiri byongewe kumashusho amwe; andi mashusho akora nkibibi.

Ni uruhe ruhare ubushyuhe τ bugira muri NT-Xent / AmakuruNCE?

Kugabanya ibisa na τ mbere ya softmax igenzura uburyo igihombo gitandukanya ibyiza nibyiza bibi.

Bigenda bite kumutwe wa SimCLR nyuma yo kwitegura?

SimCLR yasanze ibiranga mbere yo kwimura umutwe wa projection neza, bityo umutwe ujugunywa nyuma yo kwitegura.

Kuki SimCLR yashingiye kubunini bunini?

Muri SimCLR andi mashusho mugice akora nkibibi, bityo ibyiciro binini bitanga ibibi byinshi no kwiga gukomeye.