Ubuyobozi bwa tekiniki

InfoNCE na SimCLR Intego

InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya.

Incamake

InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya. SimCLR ni urwego rwibanze rwakoresheje iki gihombo kugirango wige amashusho akomeye uhereye kumibare itanditse, irwanya kugenzurwa.

InfoNCE na SimCLR Intego ninzitizi yubaka tekinike igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.

Kwibira cyane

InfoNCE (Urusaku-Itandukaniro Rigereranya Kumakuru Yamakuru) itoza kodegisi kugirango ikibazo nibyiza byukuri bifite amanota asa cyane kuruta ikibazo nibibi byinshi. Nubusanzwe ni softmax cross-entropy hejuru yamanota asa: kuri ankeri, ibyiza bigomba gutsinda ibibi. SimCLR (2020) yakoresheje ibi kumashusho: fata ishusho imwe, shyiramo ibyongeweho bibiri bidasanzwe kugirango ukore couple nziza, ukoreshe byombi ukoresheje kodegisi isangiwe wongeyeho umutwe wa projection, kandi ukoreshe ubushyuhe busanzwe bwapimye cross-entropy (NT-Xent, impinduka ya InfoNCE) kuburyo ibitekerezo byombi byiyongereye bikurura mugihe andi mashusho yose mugice akora nkibibi. SimCLR yerekanye ko kongera amakuru gukomeye, umutwe uteganijwe utagira umurongo, ingano nini yicyiciro, hamwe nubushyuhe bwahujwe hamwe reka reka moderi yiyobora ihure nabashinzwe kugenzura kuri ImageNet - nta kirango na kimwe mugihe cyo kwitegura.

Ubushishozi

NT-Xent ibara cosine isa hagati ya L2-isanzwe yashyizwemo, igabanywa nubushyuhe τ, kandi ikoresha softmax cross-entropy ifata ibyiza nkicyiciro gikwiye murugero rwose. Hasi τ ityaza isaranganya kandi ihana ibibi bikomeye. Umutwe wa SimCLR (MLP) ukoreshwa gusa mugihe cyo kwitegura no kujugunywa nyuma - guhagararirwa mbere yo kwimura umutwe neza. Ibice binini bifite akamaro kuko bitanga ibibi byinshi murwego rumwe.

Kumenya AmakuruNCE na SimCLR Intego

InfoNCE nigihombo gitandukanye cyigisha icyitegererezo cyo gukurura bibiri bihuye hamwe no gusunika byombi bidahuye mugushira umwanya. SimCLR ni urwego rwibanze rwakoresheje iki gihombo kugirango wige amashusho akomeye uhereye kumibare itanditse, irwanya kugenzurwa. InfoNCE na SimCLR Intego ninzitizi yubaka tekinike igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata InfoNCE na SimCLR Intego nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha InfoNCE na SimCLR Intego zitezimbere ubwubatsi, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza ka InfoNCE na SimCLR Intego

Intego zinyuranye zikwirakwira kure ya SimCLR: CLIP ihuza amashusho ninyandiko ukoresheje InfoNCE muburyo bumwe, kandi igihombo kimwe gitwara amajwi, amashusho, hamwe no kugarura ibintu. Ubushakashatsi ubu bugabanya kwishingikiriza kumatsinda manini nibibi byinshi binyuze muri banki yibuka (MoCo), cyangwa ikuraho ibibi byuzuye (BYOL, SimSiam, DINO). Witege ko uzakomeza kuvanga itandukaniro, gusibanganya, hamwe na masike-yerekana icyitegererezo, hamwe na multimodal ihuza (inyandiko, ishusho, amajwi) nkumupaka wiganjemo icyitegererezo.

Gushyira mu bikorwa Isi

SimCLR yerekana amashusho ya kodegisi kumafoto atanditseho, hanyuma ugahuza neza kumurongo muto washyizweho kugirango ushyirwe mubikorwa.

KANDA ukoresheje intego ya InfoNCE kugirango uhuze amashusho hamwe naya magambo, ashoboza ishusho ya zeru.

Kubaka amashusho / gushakisha aho amashusho asa yicaye hafi mumwanya wize wo gushira.

Kwiyobora wenyine kwitegura amashusho yubuvuzi cyangwa satelite aho ibirango ari bike ariko amakuru yibanze ni menshi.

Uburyo bwo Gushyira mu bikorwa

InfoNCE na SimCLR Intego mubikorwa

SimCLR yerekana amashusho ya kodegisi kumafoto atanditseho, hanyuma ugahuza neza kumurongo muto washyizweho kugirango ushyirwe mubikorwa.

SimCLR yerekana kodegisi yerekana amashusho kumafoto atanditseho ikimenyetso, hanyuma ugahuza neza kumurongo muto washyizweho kugirango ushyire mubyiciro Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

InfoNCE na SimCLR Intego mubikorwa

KANDA ukoresheje intego ya InfoNCE kugirango uhuze amashusho hamwe naya magambo, ashoboza ishusho ya zeru.

KANDA ukoresheje intego ya InfoNCE kugirango uhuze amashusho hamwe n’inyandiko zazo, bigafasha ishusho ya zeru-shusho ishyirwa mu byiciro Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

InfoNCE na SimCLR Intego mubikorwa

Kubaka amashusho / gushakisha aho amashusho asa yicaye hafi mumwanya wize wo gushira.

Kubaka amashusho agaragara / kugarura aho amashusho asa yicaye hamwe mumwanya wize wo gushiramo Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

InfoNCE na SimCLR Intego mubikorwa

Kwiyobora wenyine kwitegura amashusho yubuvuzi cyangwa satelite aho ibirango ari bike ariko amakuru yibanze ni menshi.

Kwiyobora wenyine kwipimisha amashusho yubuvuzi cyangwa satelite aho ibirango ari bike ariko amakuru yibanze ni menshi Amakipe akunze kubona umusaruro mwiza mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

!

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

!

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi