InfoNCE na SimCLR Intego
InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya.
Incamake
SimCLR is a landmark framework that used this loss to learn powerful image representations from unlabeled data, rivaling supervised pretraining.
Kwibira cyane
InfoNCE (Urusaku-Itandukaniro Rigereranya Kumakuru Yamakuru) itoza kodegisi kugirango ikibazo nibyiza byukuri bifite amanota asa cyane kuruta ikibazo nibibi byinshi. Nubusanzwe ni softmax cross-entropy hejuru yamanota asa: kuri ankeri, ibyiza bigomba gutsinda ibibi. SimCLR (2020) yakoresheje ibi kumashusho: fata ishusho imwe, shyiramo ibyongeweho bibiri bidasanzwe kugirango ukore couple nziza, ukoreshe byombi ukoresheje kodegisi isangiwe wongeyeho umutwe wa projection, kandi ukoreshe ubushyuhe busanzwe bwapimye cross-entropy (NT-Xent, impinduka ya InfoNCE) kuburyo ibitekerezo byombi byiyongereye bikurura mugihe andi mashusho yose mugice akora nkibibi. SimCLR yerekanye ko kongera amakuru gukomeye, umutwe uteganijwe utagira umurongo, ingano nini yicyiciro, hamwe nubushyuhe bwahujwe hamwe reka reka moderi yiyobora ihure nabashinzwe kugenzura kuri ImageNet - nta kirango na kimwe mugihe cyo kwitegura.
Ubushishozi
NT-Xent ibara cosine isa hagati ya L2-isanzwe yashyizwemo, igabanywa nubushyuhe τ, kandi ikoresha softmax cross-entropy ifata ibyiza nkicyiciro gikwiye murugero rwose. Hasi τ ityaza isaranganya kandi ihana ibibi bikomeye. Umutwe wa SimCLR (MLP) ukoreshwa gusa mugihe cyo kwitegura no kujugunywa nyuma - guhagararirwa mbere yo kwimura umutwe neza. Ibice binini bifite akamaro kuko bitanga ibibi byinshi murwego rumwe.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka InfoNCE na SimCLR Intego
Intego zinyuranye zikwirakwira kure ya SimCLR: CLIP ihuza amashusho ninyandiko ukoresheje InfoNCE muburyo bumwe, kandi igihombo kimwe gitwara amajwi, amashusho, hamwe no kugarura ibintu. Ubushakashatsi ubu bugabanya kwishingikiriza kumatsinda manini nibibi byinshi binyuze muri banki yibuka (MoCo), cyangwa ikuraho ibibi byuzuye (BYOL, SimSiam, DINO). Witege ko uzakomeza kuvanga itandukaniro, gusibanganya, hamwe na masike-yerekana icyitegererezo, hamwe na multimodal ihuza (inyandiko, ishusho, amajwi) nkumupaka wiganjemo icyitegererezo.
Gushyira mu bikorwa Isi
SimCLR yerekana amashusho ya kodegisi kumafoto atanditseho, hanyuma ugahuza neza kumurongo muto washyizweho kugirango ushyirwe mubikorwa.
KANDA ukoresheje intego ya InfoNCE kugirango uhuze amashusho hamwe naya magambo, ashoboza ishusho ya zeru.
Kubaka amashusho / gushakisha aho amashusho asa yicaye hafi mumwanya wize wo gushira.
Kwiyobora wenyine kwitegura amashusho yubuvuzi cyangwa satelite aho ibirango ari bike ariko amakuru yibanze ni menshi.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the InfoNCE and SimCLR Objectives quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Reba neza na Ntare
Ibibazo bikunze kubazwa
What is InfoNCE and SimCLR Objectives?
InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya. SimCLR ni urwego rwibanze rwakoresheje iki gihombo kugirango wige amashusho akomeye uhereye kumibare itanditse, irwanya kugenzurwa.
Niki intego ya InfoNCE ishishikariza icyitegererezo gukora?
InfoNCE ni softmax hejuru yibyo bisa bihembera byinshi bisa nibyiza kandi byiza bisa nibibi.
Muri SimCLR, nigute habaho couple nziza?
SimCLR ibyara couple nziza uhereye kubintu bibiri byongewe kumashusho amwe; andi mashusho akora nkibibi.
Ni uruhe ruhare ubushyuhe τ bugira muri NT-Xent / AmakuruNCE?
Kugabanya ibisa na τ mbere ya softmax igenzura uburyo igihombo gitandukanya ibyiza nibyiza bibi.
Bigenda bite kumutwe wa SimCLR nyuma yo kwitegura?
SimCLR yasanze ibiranga mbere yo kwimura umutwe wa projection neza, bityo umutwe ujugunywa nyuma yo kwitegura.
Kuki SimCLR yashingiye kubunini bunini?
Muri SimCLR andi mashusho mugice akora nkibibi, bityo ibyiciro binini bitanga ibibi byinshi no kwiga gukomeye.