Mataanaha Barlow iyo Dhimista Shaqaynta
Barlow Twins waa hab is-maamul oo barata matalaada iyadoo la samaynayo jaangooyooyinka isku-dhafan ee u dhexeeya laba aragtiyood oo la kordhiyay oo u dhow shaxanka aqoonsiga.
Dulmar
It avoids collapse through a redundancy-reduction principle rather than negatives or momentum encoders.
quusid qoto dheer
Waxaa soo jeediyay Facebook AI sanadka 2021 oo loogu magac daray mabda'a dhimista dhimista ee H. Barlow's neuroscientist, Barlow Twins waxay quudisaa laba aragtiyood oo qalloocan oo muuqaal ah iyada oo loo marayo shabakado isku mid ah si ay u soo saaraan laba qaybood oo dhejis ah. Waxay xisaabinaysaa jaantuska isku-dhafan ee u dhexeeya qaybaha labadan vector ee isku-xidhka ah, ee lagu cabbiray dufcadda oo dhan. Ujeedadu waxay u riixaysaa jaantuskan dhanka aqoonsiga: Gelida xagal waa inay ahaadaan 1 ( sifo kastaa way ka duwan tahay kordhinta) iyo galitaanka gees-dhaafka ahi waa inay ahaadaan 0 ( astaamo kala duwan ayaa la qurxiyaa, yaraynta dib u soo celinta). Erayga xagal-ku-jiidka ahi waxa uu xoojinayaa is-bedbeddelka; Ereyga dhimista dib-u-celinta ka-baxsan-geeska ayaa si dabiici ah uga hortagaysa burburka sababtoo ah sifooyinka la isku qurxiyo dhammaantood isku mid ma noqon karaan. Si ka duwan BYOL uma baahna asymmetry, saadaaliye, ama joogsi-joojin, oo si ka duwan SimCLR uma baahna lammaane taban, in kasta oo ay ka faa'iidaysato dhejisyada cabbirka sarreeya.
Aragtida Farsamada
Khasaarku waxa uu leeyahay laba qaybood oo lagu soo koobay isku-xidhka isku-dhafan ee matrix C: wadar ah (1 - C_ii) ^2 ereyada isdhaafka ah ee xagasha, oo lagu daray wadarta lambda-miisaanka ah ee C_ij^2 ereyada shaqo-ka-dhaafka ah. Sababtoo ah matrixku waa mid caadi ah oo ka sarreeya dufcada, habka ayaa si caddaalad ah u adag in la cabbiro cabbirka, faa'iido la taaban karo oo ka badan hababka ka duwan ee gaajada kooxo badan oo taban. Miisaanka waxqabadka oo leh cabbirka gundhigga, sidaa darteed majaajiliistaha ayaa badanaa aad u ballaaran.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Mataanaha Barlow iyo Dhimista Shaqaynta
Barlow Twins waxay gacan ka gaysatay kicinta qoyska xogta-aragtida ah ee hababka is-maamula, gaar ahaan VICReg, kaas oo si cad u kala sooca kala duwanaanshiyaha, is-dhaafsiga, iyo ereyada wada noolaanshaha. Filo dib-u-dhimista-yaraynta iyo ujeedooyinka-qurxinta sifada si aan u sii wadno wargelinta sida aan u sii tababarno cod-bixiyeyaasha soo saara sifooyin kooban, oo aan-ka-kas ahayn, iyo in la kordhiyo wax ka baxsan sawirrada qaab-mutimodal iyo waqti-taxane ah halkaas oo la isku qurxiyo, muuqaallo adag ayaa ka caawiya moodooyinka hoose in ay wax ka bartaan calaamado xaddidan.
Dhaqangelinta Adduunka-dhabta ah
Kahortababaridda sawir-qaadaha kuwaas oo soo saara astaamo la isku qurxiyo oo faa'iido u leh kala-soocidda hoose oo leh xog xaddidan.
Tababarka qalabka dhexdhexaadka ah oo ay dufcadaha taban ee waaweyni ay yihiin kuwo aan macquul ahayn, maadaama Barlow Twins ay yihiin kuwo aan dareen lahayn.
Soo saarista qalabyo is haysta, oo aan la soo celin karin oo loogu talagalay ururinta ama ogaanshaha cilladaha ee sawirka dareemayaasha warshadaha.
U adeegaya sidii saldhig is-xakameyn oo salka ku haya cilmi-baarista isbarbardhigga xeeladaha ka-hortagga burburka ee SimCLR, BYOL, iyo VICReg.
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Barlow Twins and Redundancy Reduction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Silsilad-xaqiijinta dhimista dhalanteedka
Su'aalaha soo noqnoqda
What is Barlow Twins and Redundancy Reduction?
Barlow Twins waa hab is-maamul oo barata matalaada iyadoo la samaynayo jaangooyooyinka isku-dhafan ee u dhexeeya laba aragtiyood oo la kordhiyay oo u dhow shaxanka aqoonsiga. Waxay ka fogaataa burburka iyada oo loo marayo mabda'a dib-u-yaraynta halkii ay ka ahaan lahayd kuwa taban ama cod-bixiyeyaal.
Matrix noocee ah ayay Barlow Twins isku dayaan inay u riixaan dhinaca aqoonsiga?
Barlow Twins waxay kaxaysaa jaantuska isku-dhafan ee u dhexeeya labada aragti ee qaybaha isku xidhka ee shaxanka aqoonsiga.
Maxay dhiirigelisaa gelitaanka diagonal ee jaantuska aqoonsiga bartilmaameedka?
Gelida geeslaha ah ee u dhow 1 waxay la macno tahay sifo kastaa waxay uga jawaabtaa isku mid labada aragtiyood ee la kordhiyey, iyada oo xoojinaysa is khilaafsan.
Maxay fulisaa galitaanka gees-ka-baxsan ee lagu wado eber?
Zero off-diagonals micnaheedu waa astaamo kala duwan ayaa la isku qurxiyay, kuwaas oo labaduba yareynaya dib-u-celinta oo joojisa burburka aan yarayn.
Mabda'a cilmiga neerfaha yaa dhiirigeliyay habka magaca iyo fikradda?
Habka waxaa loogu magac daray H. Barlow iyo mabda'a dhimis-yaraynta ee codaynta neerfaha ee hufan.
Marka la barbar dhigo BYOL, maxay Barlow Twins U baahnayn?
Barlow Twins waxay isticmaashaa shabakado isku mid ah oo aan lahayn wax saadaaliya, joogsiga-joojinta, ama bartilmaameedka EMA, iyaga oo ku tiirsan beddelka lumitaanka dhimista.