Impanga ya Barlow no Kugabanuka
Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix.
Incamake
It avoids collapse through a redundancy-reduction principle rather than negatives or momentum encoders.
Kwibira cyane
Byasabwe na Facebook AI mu 2021 kandi byitirirwa ihame ryo kugabanya ubudahangarwa bw’imyororokere H. Barlow, Barlow Twins itanga ibitekerezo bibiri bigoramye ku ishusho binyuze mu miyoboro imwe kugira ngo ikore ibice bibiri byo gushyiramo. Iharura matrike yambukiranya hagati yibice bigize ibice bibiri byinjizwamo, bipimirwa murwego rwose. Intego isunika iyi matrix yerekeza kumuranga: ibyinjira bya diagonal bigomba kuba 1 (buri kintu ntigishobora guhinduka) kandi ibyinjira hanze ya diagonal bigomba kuba 0 (ibintu bitandukanye birasobanutse, bigabanya ubudahangarwa). Ijambo kuri diagonal ryubahiriza guhinduka; ijambo ritagabanije-kugabanya ijambo risanzwe ririnda gusenyuka kuko ibintu bitandukanijwe ntibishobora kuba bimwe. Bitandukanye na BYOL ntabwo ikeneye asimmetrie, guhanura, cyangwa guhagarara-gahoro, kandi bitandukanye na SimCLR ntabwo ikeneye ibice bibiri bibi, nubwo byunguka gushira murwego rwo hejuru.
Ubushishozi
Igihombo gifite ibice bibiri byegeranijwe hejuru ya matrisa C: igiteranyo cya (1 - C_ii) ^ 2 imvugo idahinduka kuri diagonal, hiyongereyeho na labda iremereye ya C_ij ^ 2 itagabanije. Kuberako matrisa isanzwe hejuru yicyiciro, uburyo burakomeye rwose kubunini bwicyiciro, inyungu ifatika kurenza uburyo butandukanye butandukanye ninzara yibice byinshi bibi. Umunzani wimikorere hamwe no gushyiramo ibipimo, umushinga rero ni mugari cyane.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'impanga za Barlow no Kugabanuka
Barlow Twins yafashije gukurura amakuru-theoretike yumuryango wuburyo bwigenga, cyane cyane VICReg, itandukanya itandukaniro, kudahinduka, hamwe namagambo ya covariance. Tegereza kugabanuka-kugabanuka hamwe nintego-gutesha agaciro intego yo gukomeza kumenyesha uburyo twirinda kodegisi itanga ibintu byoroheje, bitarenze urugero, no kwagura amashusho mumashusho menshi kandi akurikirana mugihe aho bitandukanijwe, imbaraga zikomeye zifasha moderi zo hasi kwigira kubirango bike.
Gushyira mu bikorwa Isi
Gutegura amashusho ya kodegisi itanga ibintu bitandukanijwe bifite akamaro kumurongo wo hasi hamwe namakuru make yanditseho amakuru.
Amahugurwa ku byuma biciriritse aho ibyiciro binini bitari byiza, kubera ko Barlow Twins isa nubunini-buke butumva.
Kubyara ibintu byoroshye, bidashyirwa mubikorwa byo guhuriza hamwe cyangwa gutahura ibintu bidasanzwe mumashusho yerekana inganda.
Gukora nkibanze byigenga mubushakashatsi ugereranije ingamba zo kwirinda gusenyuka muri SimCLR, BYOL, na VICReg.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Barlow Twins and Redundancy Reduction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Urunigi-rwo-Kugenzura Kugabanya Hallucination
Ibibazo bikunze kubazwa
What is Barlow Twins and Redundancy Reduction?
Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix. Irinda gusenyuka binyuze mu ihame ryo kugabanya-kugabanuka aho kuba ibibi cyangwa kodegisi.
Ni matrike ki Barlow Twins igerageza gusunika kumuranga?
Impanga ya Barlow itwara matrisa yambukiranya hagati yuburyo bubiri bwo gushiramo ibice byerekana indangamuntu.
Niki cyanditswemo diagonal ya materix yibiranga intego?
Diagonal ibyanditswe hafi ya 1 bivuze ko buri kintu gisubiza kimwe kubitekerezo byombi byongerewe, bikurikiza invariance.
Niki ibyanditswe hanze ya diagonal bigenda kuri zeru bigeraho?
Zeru-diagonals isobanura ibintu bitandukanye bitandukanijwe, byombi bigabanya ubudahangarwa kandi bigahagarika gusenyuka.
Ninde ihame rya neuroscience ryahumekeye izina nigitekerezo?
Uburyo bwitiriwe H. Barlow hamwe nihame rye ryo kugabanya kugabanuka kwimikorere myiza.
Ugereranije na BYOL, Impanga za Barlow NTIBISA iki?
Impanga za Barlow zikoresha imiyoboro imwe idafite abahanuzi, bahagarika-icyiciro, cyangwa intego ya EMA, bashingiye aho gutakaza igabanuka.