Ubuyobozi bwa tekiniki

Impanga ya Barlow no Kugabanuka

Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix.

Incamake

Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix. Irinda gusenyuka binyuze mu ihame ryo kugabanya-kugabanuka aho kuba ibibi cyangwa kodegisi.

Impanga ya Barlow na Redundancy Kugabanuka ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.

Kwibira cyane

Byasabwe na Facebook AI mu 2021 kandi byitirirwa ihame ryo kugabanya ubudahangarwa bw’imyororokere H. Barlow, Barlow Twins itanga ibitekerezo bibiri bigoramye ku ishusho binyuze mu miyoboro imwe kugira ngo ikore ibice bibiri byo gushyiramo. Iharura matrike yambukiranya hagati yibice bigize ibice bibiri byinjizwamo, bipimirwa murwego rwose. Intego isunika iyi matrix yerekeza kumuranga: ibyinjira bya diagonal bigomba kuba 1 (buri kintu ntigishobora guhinduka) kandi ibyinjira hanze ya diagonal bigomba kuba 0 (ibintu bitandukanye birasobanutse, bigabanya ubudahangarwa). Ijambo kuri diagonal ryubahiriza guhinduka; ijambo ritagabanije-kugabanya ijambo risanzwe ririnda gusenyuka kuko ibintu bitandukanijwe ntibishobora kuba bimwe. Bitandukanye na BYOL ntabwo ikeneye asimmetrie, guhanura, cyangwa guhagarara-gahoro, kandi bitandukanye na SimCLR ntabwo ikeneye ibice bibiri bibi, nubwo byunguka gushira murwego rwo hejuru.

Ubushishozi

Igihombo gifite ibice bibiri byegeranijwe hejuru ya matrisa C: igiteranyo cya (1 - C_ii) ^ 2 imvugo idahinduka kuri diagonal, hiyongereyeho na labda iremereye ya C_ij ^ 2 itagabanije. Kuberako matrisa isanzwe hejuru yicyiciro, uburyo burakomeye rwose kubunini bwicyiciro, inyungu ifatika kurenza uburyo butandukanye butandukanye ninzara yibice byinshi bibi. Umunzani wimikorere hamwe no gushyiramo ibipimo, umushinga rero ni mugari cyane.

Kumenya Barlow Impanga no Kugabanuka

Barlow Twins nuburyo bwigenzurwa bwiga guhagararirwa mugukora matrisa ihuza isano hagati yibitekerezo bibiri byongerewe hafi ya matrix. Irinda gusenyuka binyuze mu ihame ryo kugabanya-kugabanuka aho kuba ibibi cyangwa kodegisi. Impanga ya Barlow na Redundancy Kugabanuka ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata Barlow Twins na Redundancy Reduction nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha Barlow Twins na Redundancy Kugabanya uburyo bwiza bwubaka, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza h'impanga za Barlow no Kugabanuka

Barlow Twins yafashije gukurura amakuru-theoretike yumuryango wuburyo bwigenga, cyane cyane VICReg, itandukanya itandukaniro, kudahinduka, hamwe namagambo ya covariance. Tegereza kugabanuka-kugabanuka hamwe nintego-gutesha agaciro intego yo gukomeza kumenyesha uburyo twirinda kodegisi itanga ibintu byoroheje, bitarenze urugero, no kwagura amashusho mumashusho menshi kandi akurikirana mugihe aho bitandukanijwe, imbaraga zikomeye zifasha moderi zo hasi kwigira kubirango bike.

Gushyira mu bikorwa Isi

Gutegura amashusho ya kodegisi itanga ibintu bitandukanijwe bifite akamaro kumurongo wo hasi hamwe namakuru make yanditseho amakuru.

Amahugurwa ku byuma biciriritse aho ibyiciro binini bitari byiza, kubera ko Barlow Twins isa nubunini-buke butumva.

Kubyara ibintu byoroshye, bidashyirwa mubikorwa byo guhuriza hamwe cyangwa gutahura ibintu bidasanzwe mumashusho yerekana inganda.

Gukora nkibanze byigenga mubushakashatsi ugereranije ingamba zo kwirinda gusenyuka muri SimCLR, BYOL, na VICReg.

Uburyo bwo Gushyira mu bikorwa

Barlow Impanga no Kugabanuka Kugabanuka mubikorwa

Gutegura amashusho ya kodegisi itanga ibintu bitandukanijwe bifite akamaro kumurongo wo hasi hamwe namakuru make yanditseho amakuru.

Gutegura amashusho ya kodegisi itanga ibintu bitandukanijwe bifite akamaro muburyo bwo gutondekanya ibyiciro hamwe namakuru make yanditseho Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Barlow Impanga no Kugabanuka Kugabanuka mubikorwa

Amahugurwa ku byuma biciriritse aho ibyiciro binini bitari byiza, kubera ko Barlow Twins isa nubunini-buke butumva.

Amahugurwa ku byuma biciriritse aho ibyiciro binini bidakwiye, kubera ko Barlow Twins isa nubunini bwingero zidafite amakipe Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Barlow Impanga no Kugabanuka Kugabanuka mubikorwa

Kubyara ibintu byoroshye, bidashyirwa mubikorwa byo guhuriza hamwe cyangwa gutahura ibintu bidasanzwe mumashusho yerekana inganda.

Kubyara ibintu byoroheje, bidahwitse byo gukusanya cyangwa gutahura ibintu mu mashusho yerekana ibyuma byerekana inganda Amakipe akunze kubona umusaruro ushimishije iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Barlow Impanga no Kugabanuka Kugabanuka mubikorwa

Gukora nkibanze byigenga mubushakashatsi ugereranije ingamba zo kwirinda gusenyuka muri SimCLR, BYOL, na VICReg.

Gukora nk'ibanze byigenga mu bushakashatsi ugereranije ingamba zo kwirinda gusenyuka hirya no hino mu makipe ya SimCLR, BYOL, na VICReg ubusanzwe babona umusaruro ushimishije iyo basobanuye ibipimo ngenderwaho byimbere, bagakomeza inzira yo kuzamuka kwabantu kubibazo bikabije, kandi bagakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

!

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

!

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi