Ubuyobozi bwa tekiniki

Kwiga Bitandukanye

Kwiga bivuguruzanya byigisha icyitegererezo cyo gukurura ibintu bisa hamwe no gusunika ibintu bidasa mumwanya ushizwemo.

2 min somaIbiherutse kuvugururwa

Incamake

It matters because it lets AI learn powerful representations from mostly unlabeled data, powering image search, recommendations, and multimodal models.

Kwibira cyane

Aho guhanura ikirango, imyigire itandukanye yiga kubigereranya: ukurikije ikintu cya ankeri, icyitegererezo cyatojwe kuburyo guhuza 'ibyiza' bihuza hafi yacyo mumwanya wa vectori mugihe bidahuye nubutaka 'bubi' kure. Uburyo busanzwe bwo kwiyobora (nka SimCLR) butanga ibyiza bifata ibyongeweho bibiri bidasanzwe byishusho imwe (ibihingwa, ibara rya jitter, blur); ibindi byose mubyiciro nibibi. Ikarita yicyitegererezo yinjiza kuri vectors hamwe nigihombo ihemba byinshi bisa kubiri hamwe no guhuza bike kubisigaye. Ibi bitanga ibishushanyo aho intera igaragaza ibisobanuro, bityo umurimo wo hasi ukenera ibirango bike cyane. CLIP ikoresha igitekerezo kimwe muburyo bumwe, ihuza amashusho kumutwe wabo.

Ubushishozi

Igihombo cyakazi ni InfoNCE (softmax hejuru yamanota asa), akenshi hamwe na cosine isa igabanijwe nubushyuhe bugenzura uburyo ibyiza bitoneshwa. Byibanze, imikorere iratera imbere hamwe nibibi byinshi, kuburyo ibyiciro binini cyangwa banki yibuka / umurongo (nko muri MoCo) ubitanga. Uburyo bumwe nka BYOL na SimSiam buta ibibi bigaragara hanyuma ugakoresha umuvuduko cyangwa guhagarara-buhoro buhoro intego yo kwirinda kugirango isenyuke, aho gushyiramo byose biba bimwe.

Ingaruka z'Ingamba

Igiciro na bije

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo bisobanutse

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Kugenzura ubuziranenge

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Ejo hazaza ho Kwiga Bitandukanye

Kwiga gutandukanya ni uguhuza hamwe na masike kandi yibyara kwiyobora mu ntego zivanze zifata isi yose hamwe nibisobanuro byiza. Ingaruka nini nini ni multimodal: itandukanye igereranya amashusho-inyandiko (na none amajwi na videwo) gushiramo gushigikira gushakisha, kugarura ibisekuru byongerewe, hamwe na zeru-shusho, kandi ikirenge kizakura. Tegereza imirimo myinshi yo kugabanya ubushake bwibyiciro byinshi, kubijyanye no kongera no gufata ingamba mbi zo gucukura amabuye y'agaciro, no kwagura inzira kuri domaine nko gufata amashusho yubuvuzi hamwe nigihe gikurikirana aho ibirango ari bike kandi bihenze.

Gushyira mu bikorwa Isi

CLIP wige ishusho-isanganywe umwanya uhuriweho kugirango ubashe gushakisha isomero ryamafoto hamwe ninteruro yanditse nka 'imbwa kuri skateboard'.

Gutegura umugongo w'icyerekezo hamwe na SimCLR ku mafoto atanditseho ikimenyetso, hanyuma ukayihuza neza kugirango umenye indwara hamwe n'akantu gato kanditseho.

Kubaka ibicuruzwa cyangwa indirimbo ibyifuzo aho gushyiramo ibintu umukoresha yakundaga kwicara hamwe kugirango ubone hafi-umuturanyi.

Sisitemu yo kugenzura isura itoza gushira kuburyo amafoto abiri yumuntu umwe ari hafi kandi abantu batandukanye baratandukanye.

Ingaruka & Kurinda

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Contrastive Learning quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ibibazo bikunze kubazwa

What is Contrastive Learning?

Kwiga bivuguruzanya byigisha icyitegererezo cyo gukurura ibintu bisa hamwe no gusunika ibintu bidasa mumwanya ushizwemo. Nibyingenzi kuko ireka AI ikamenya guhagararirwa gukomeye kuva amakuru atanditseho, gushakisha amashusho, ibyifuzo, hamwe na moderi nyinshi.

Niyihe ntego nyamukuru yo kwiga gutandukanya?

Kwiga gutandukanya gushushanya umwanya wo gushiramo kuburyo guhuza byombi byegeranye kandi bidahuye byombi biratandukanye.

Muburyo bwigenga bwishusho nka SimCLR, nigute habaho couple nziza?

SimCLR ikora ibintu byiza bivuye muburyo bubiri bwongerewe ishusho imwe, hamwe nandi mashusho mugice gikora nkibibi.

Nibihe bikorwa byo gutakaza bifitanye isano no kwiga bitandukanye?

InfoNCE, softmax hejuru yamanota asa nubushyuhe, niyo ntego isanzwe itandukanye.

Kuki uburyo nka MoCo bukoresha banki yibuka cyangwa umurongo?

Inyungu zinyuranye zo kwiga zituruka kubibi byinshi; umurongo ubatanga mugihe ugumisha ingano yicyiciro.

Ni ikihe kibazo BYOL na SimSiam birinda byumwihariko badakoresheje ibibi bigaragara?

Hatariho ibibi, icyitegererezo gishobora gushushanya ibintu byose kuri vector imwe; guhagarika-buhoro hamwe nintego zihuta birinda gusenyuka.