Barlow Twins ati Apọju Idinku
Barlow Twins jẹ ọna abojuto ti ara ẹni ti o kọ ẹkọ awọn aṣoju nipa ṣiṣe matrix ibamu-agbelebu laarin awọn iwo afikun meji ti o sunmọ si matrix idanimọ.
Akopọ
It avoids collapse through a redundancy-reduction principle rather than negatives or momentum encoders.
Jin Dive
Dabaa nipasẹ Facebook AI ni 2021 ati oniwa lẹhin neuroscientist H. Barlow ká apọju-idinku opo, Barlow Twins ifunni meji daru wiwo ti ohun image nipasẹ awọn nẹtiwọki kanna lati gbe awọn ipele meji ti awọn ifibọ. O ṣe iṣiro matrix ibamu-agbelebu laarin awọn paati ti awọn ifisinu ifisinu meji wọnyi, ni iwọn kọja ipele naa. Idi ti nfa matrix yii si ọna idanimọ: awọn titẹ sii diagonal yẹ ki o jẹ 1 (ẹya-ara kọọkan jẹ aibikita si augmentation) ati awọn titẹ sii ita-rọsẹ yẹ ki o jẹ 0 (awọn ẹya ara ẹrọ ti o yatọ si jẹ ohun ọṣọ, idinku apọju). Oro on-rọsẹ fi agbara mu aiṣedeede; Oro idinku-idinku ni pipa-rọsẹ-rọsẹ nipa ti ṣe idilọwọ iṣubu nitori awọn ẹya ti ohun ọṣọ ko le jẹ aami kanna. Ko dabi BYOL ko nilo asymmetry, asọtẹlẹ, tabi idaduro-gradient, ati pe ko dabi SimCLR ko nilo awọn orisii odi, botilẹjẹpe o ni anfani lati awọn ifibọ iwọn-giga.
Imọ-imọ-ẹrọ
Pipadanu naa ni awọn apakan meji ti a ṣe akopọ lori matrix ibamu-agbelebu C: apao ti (1 - C_ii) ^2 awọn ofin aibikita lori akọ-rọsẹ, pẹlu apao iwuwo-lambda ti C_ij^2 awọn ofin apọju akọ-rọsẹ. Nitoripe matrix naa jẹ deede lori ipele, ọna naa jẹ iṣẹtọ logan si iwọn ipele, anfani ti o wulo lori awọn ọna iyatọ ti ebi fun awọn ipele nla ti awọn odi. Awọn irẹjẹ iṣẹ pẹlu iwọn iwọn ifisinu, nitorinaa awọn pirojekito nigbagbogbo gbooro pupọ.
Ipa Ilana
Iye owo ati isuna
Awọn ipinnu faaji ṣe awakọ iṣẹ ati idiyele iṣẹ fun awọn ọdun.
Awọn ipinnu diẹ sii
Ẹkọ imọ-ẹrọ ṣe iranlọwọ fun awọn ẹgbẹ lati yan akopọ to tọ, kii ṣe ọkan tuntun nikan.
Iṣakoso didara
Awọn yiyan imọ-ẹrọ to dara julọ dinku awọn iṣẹlẹ igbẹkẹle ni iṣelọpọ.
Ojo iwaju ti Barlow Twins ati Idinku Apọju
Barlow Twins ṣe iranlọwọ lati tan idile alaye-imọran ti awọn ọna abojuto ti ara ẹni, pataki julọ VICReg, eyiti o ya iyatọ, aibikita, ati awọn ofin ibaramu ni gbangba. Reti idinku-idinku ati awọn ibi-afẹde ẹya-ara lati tọju ifitonileti bii a ṣe kọ awọn koodu koodu ti o ṣe agbejade iwapọ, awọn ẹya ti kii ṣe laiṣe, ati lati fa kọja awọn aworan sinu multimodal ati awọn eto jara-akoko nibiti awọn ohun ọṣọ, awọn aṣoju to lagbara ṣe iranlọwọ fun awọn awoṣe isalẹ lati kọ ẹkọ lati awọn aami to lopin.
Real-World imuse
Awọn koodu koodu iṣaju ikẹkọ ti o mu awọn ẹya ti o ni ibatan si awọn ẹya ti o wulo fun isọdi isalẹ pẹlu data aami to lopin.
Ikẹkọ lori ohun elo iwọntunwọnsi nibiti awọn ipele odi nla ko wulo, nitori Barlow Twins jẹ aibikita iwọn-iwọn.
Ṣiṣẹda iwapọ, awọn ifibọ aisi-padabọ fun ikojọpọ tabi wiwa anomaly ni aworan sensọ ile-iṣẹ.
Ṣiṣẹ bi ipilẹ-abojuto ti ara ẹni ninu iwadi ti o ṣe afiwe awọn ilana imukuro-idasilẹ kọja SimCLR, BYOL, ati VICReg.
Awọn ewu & Awọn ọna iṣọ
Ṣiṣepe ala-ilẹ kan le tọju awọn ailagbara eto ti o gbooro.
Awọn ohun elo amayederun ati awọn idiyele itọju nigbagbogbo ni aibikita.
Aabo ati awọn ela akiyesi le dagba bi awọn eto ṣe di eka sii.
Ilana Ilana imuse
Ṣetumo lairi, didara, ati awọn ibi-afẹde idiyele ṣaaju imuse.
Aṣepari labẹ ẹru ojulowo ati awọn ipo data.
Abojuto ohun elo fun awọn aṣiṣe, fiseete, ati ipa olumulo.
Mura ipadasẹhin pada ati awọn ipa ọna esi iṣẹlẹ ṣaaju iwọn.
Tesiwaju Ṣiṣawari
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Barlow Twins and Redundancy Reduction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Itọsọna atẹle
Pq-ti-Ijerisi fun Idinku Hallucination
Awọn ibeere ti a beere nigbagbogbo
What is Barlow Twins and Redundancy Reduction?
Barlow Twins jẹ ọna abojuto ti ara ẹni ti o kọ ẹkọ awọn aṣoju nipa ṣiṣe matrix ibamu-agbelebu laarin awọn iwo afikun meji ti o sunmọ si matrix idanimọ. O yago fun iṣubu nipasẹ ipilẹ-idinku idinku dipo awọn odi tabi awọn koodu ipanu.
Matrix wo ni Barlow Twins gbiyanju lati Titari si idanimọ naa?
Barlow Twins wakọ matrix ibamu-agbelebu laarin awọn iwo meji 'awọn ohun elo ifibọ si ọna matrix idanimo.
Kini awọn titẹ sii diagonal ti matrix idanimọ ibi-afẹde ṣe iwuri fun?
Awọn titẹ sii akọ-rọsẹ nitosi 1 tumọ si ẹya kọọkan ṣe idahun kanna si awọn iwo ti o pọ si, ti o fi agbara mu aibikita.
Kini awọn titẹ sii ala-rọsẹ ti a n wa si odo ṣe aṣeyọri?
Awọn abọ-rọsẹ-odo odo tumọ si awọn ẹya oriṣiriṣi jẹ ohun ọṣọ, eyiti mejeeji dinku apọju ati da duro iṣubu bintin.
Ilana ti neuroscience tani ṣe atilẹyin orukọ ati imọran ọna naa?
Awọn ọna ti wa ni oniwa lẹhin H. Barlow ati awọn re apọju-idinku opo ti daradara nkankikan ifaminsi.
Ni afiwe pẹlu BYOL, kini Barlow Twins KO nilo?
Barlow Twins nlo awọn nẹtiwọọki kanna ti ko si asọtẹlẹ, idaduro-gradient, tabi ibi-afẹde EMA, ti o gbẹkẹle ipadanu idinku-idinku.