Ubuyobozi bwa tekiniki

Impanga ya Barlow no Kugabanuka

Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza h'impanga za Barlow no Kugabanuka
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

It avoids collapse through a redundancy-reduction principle rather than negatives or momentum encoders.

Kwibira cyane

Byasabwe na Facebook AI mu 2021 kandi byitirirwa ihame ryo kugabanya ubudahangarwa bw’imyororokere H. Barlow, Barlow Twins itanga ibitekerezo bibiri bigoramye ku ishusho binyuze mu miyoboro imwe kugira ngo ikore ibice bibiri byo gushyiramo. Iharura matrike yambukiranya hagati yibice bigize ibice bibiri byinjizwamo, bipimirwa murwego rwose. Intego isunika iyi matrix yerekeza kumuranga: ibyinjira bya diagonal bigomba kuba 1 (buri kintu ntigishobora guhinduka) kandi ibyinjira hanze ya diagonal bigomba kuba 0 (ibintu bitandukanye birasobanutse, bigabanya ubudahangarwa). Ijambo kuri diagonal ryubahiriza guhinduka; ijambo ritagabanije-kugabanya ijambo risanzwe ririnda gusenyuka kuko ibintu bitandukanijwe ntibishobora kuba bimwe. Bitandukanye na BYOL ntabwo ikeneye asimmetrie, guhanura, cyangwa guhagarara-gahoro, kandi bitandukanye na SimCLR ntabwo ikeneye ibice bibiri bibi, nubwo byunguka gushira murwego rwo hejuru.

Gushyira mu bikorwa Isi

Gutegura amashusho ya kodegisi itanga ibintu bitandukanijwe bifite akamaro kumurongo wo hasi hamwe namakuru make yanditseho amakuru.

Amahugurwa ku byuma biciriritse aho ibyiciro binini bitari byiza, kubera ko Barlow Twins isa nubunini-buke butumva.

Kubyara ibintu byoroshye, bidashyirwa mubikorwa byo guhuriza hamwe cyangwa gutahura ibintu bidasanzwe mumashusho yerekana inganda.

Gukora nkibanze byigenga mubushakashatsi ugereranije ingamba zo kwirinda gusenyuka muri SimCLR, BYOL, na VICReg.

Ejo hazaza h'impanga za Barlow no Kugabanuka

Barlow Twins yafashije gukurura amakuru-theoretike yumuryango wuburyo bwigenga, cyane cyane VICReg, itandukanya itandukaniro, kudahinduka, hamwe namagambo ya covariance. Tegereza kugabanuka-kugabanuka hamwe nintego-gutesha agaciro intego yo gukomeza kumenyesha uburyo twirinda kodegisi itanga ibintu byoroheje, bitarenze urugero, no kwagura amashusho mumashusho menshi kandi akurikirana mugihe aho bitandukanijwe, imbaraga zikomeye zifasha moderi zo hasi kwigira kubirango bike.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Barlow Twins and Redundancy Reduction quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Barlow Twins and Redundancy Reduction?

Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix. Irinda gusenyuka binyuze mu ihame ryo kugabanya-kugabanuka aho kuba ibibi cyangwa kodegisi.

What does Barlow Twins compare during representation learning?

The method forms a cross-correlation matrix from representations of two distorted views.

What target does the Barlow Twins objective push the cross-correlation matrix toward?

The paper defines the objective by making the cross-correlation matrix close to identity.

What does a diagonal term in the objective encourage?

The diagonal term encourages invariance between matching feature components.

What does the off-diagonal penalty encourage?

The method reduces redundancy by pushing off-diagonal correlations toward zero.

How does Barlow Twins differ from methods that require negative pairs?

The original Barlow Twins paper describes avoiding negatives and matching the cross-correlation matrix to identity.