Ubuyobozi bwa tekiniki

Kugabanuka-Kumenya Kugabanuka

Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze.

Incamake

Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze. Flatter minima ikunda kuba rusange muri rusange, SAM rero ikunze kunoza ikizamini cyukuri no gukomera udahinduye imiterere yicyitegererezo.

Gukarishye-Kumenya Kugabanya ni tekinoroji yo kubaka igira ingaruka ku bwiza bw'icyitegererezo, igiciro cy'ibikorwa remezo, ubukererwe, no kwizerwa ku gipimo.

Kwibira cyane

Amahugurwa asanzwe agabanya igihombo kumwanya umwe muburemere, ariko ibisubizo bibiri hamwe no gutakaza imyitozo imwe birashobora kwitwara muburyo butandukanye: byibuze 'umuto' muto wicaye mukibaya kigufi aho uburemere buke butera igihombo, mugihe byibuze 'igorofa' yihanganira kwangirika kandi mubisanzwe muri rusange nibyiza bitagaragara. SAM, yatangijwe na Google abashakashatsi muri 2020, irabigaragaza neza. Kuri buri ntambwe ibanza kubona uburemere bwegereye (muri radiyo ntoya rho) bugabanya cyane igihombo - umuturanyi mubi-mubi - hanyuma akavugurura uburemere bwumwimerere kugirango agabanye igihombo kuri iyo ngingo. Iyi min-max intego itera gusunikisha uturere turi hasi cyane, bitanga umusaruro ugaragara muburyo rusange bwo gushushanya amashusho no hanze yacyo.

Ubushishozi

Buri ntambwe ya SAM ni passes ebyiri. Ubwa mbere, ubare igipimo cyibipimo byubu hanyuma ufate 'kuzamuka' intambwe yubunini rho mu cyerekezo cya gradient kugirango ugere kubintu bibi cyane hafi. Icya kabiri, bara gradient kuri iyo ngingo ihungabanye kandi uyikoreshe kugirango uvugurure uburemere bwumwimerere. Radiyo rho igenzura uburyo umuturanyi urinda. Igiciro ni hafi ebyiri zinyuma-zisubira inyuma kuri buri ntambwe, zikubye kabiri kubara - ingenzi nyamukuru.

Kumenya Gukarisha-Kumenya Kugabanuka

Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze. Flatter minima ikunda kuba rusange muri rusange, SAM rero ikunze kunoza ikizamini cyukuri no gukomera udahinduye imiterere yicyitegererezo. Gukarishye-Kumenya Kugabanya ni tekinoroji yo kubaka igira ingaruka ku bwiza bw'icyitegererezo, igiciro cy'ibikorwa remezo, ubukererwe, no kwizerwa ku gipimo. Kugirango wubake byimbitse, fata Sharpness-Aware Minimization nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mubimenyerezo, amakipe akomeye akoresha Sharpness-Aware Minimisiyasi itezimbere imyubakire, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza Kukarishye-Kumenya Kugabanuka

SAM yabyaye umuryango wabakurikirana ugamije intege nke zawo, kubara kabiri: impinduka nziza nka ESAM, LookSAM, nuburyo bukoresha agace gato k'ibiro cyangwa ugakoresha SAM buri ntambwe nkeya. Adaptive SAM (ASAM) yongeye guhindura radiyo kugirango ibe igipimo-kidahinduka. Abashakashatsi bakomeje kujya impaka neza impamvu uburinganire bufasha nuburyo bwo kubipima, kandi ibitekerezo-bikarishye bikwirakwira muguhuza neza imvugo nini yindimi no kunoza imbaraga zo guhinduranya.

Gushyira mu bikorwa Isi

Kuzamura Vision Transformer hamwe na ResNet byukuri kuri ImageNet mumahugurwa hamwe na SAM aho kuba SGD isanzwe.

Kunoza imbaraga zo kuranga urusaku, kuva minima iringaniye ntibishobora gufata mu mutwe ibirango byangiritse.

Kuringaniza neza imiterere yururimi rwateganijwe hamwe na SAM kugirango ubone rusange rusange kuri datasets ntoya.

Gukoresha variant ya ESAM cyangwa LookSAM mugihe ibiciro byikubye kabiri bya vanilla SAM bihenze cyane.

Uburyo bwo Gushyira mu bikorwa

Gukarishye-Kumenya Kugabanuka mubikorwa

Kuzamura Vision Transformer hamwe na ResNet byukuri kuri ImageNet mumahugurwa hamwe na SAM aho kuba SGD isanzwe.

Kuzamura Vision Transformer hamwe na ResNet byukuri kuri ImageNet mumahugurwa hamwe na SAM aho Amakipe asanzwe ya SGD mubisanzwe abona ibisubizo byiza mugihe basobanuye ibipimo ngenderwaho byimbere, bagakomeza inzira yo kuzamuka kwabantu kubibazo byimbitse, kandi bagakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Gukarishye-Kumenya Kugabanuka mubikorwa

Kunoza imbaraga zo kuranga urusaku, kuva minima iringaniye ntibishobora gufata mu mutwe ibirango byangiritse.

Kunoza imbaraga kugirango ushireho urusaku, kubera ko minima iringaniye idakunze gufata mu mutwe ibirango byangiritse Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Gukarishye-Kumenya Kugabanuka mubikorwa

Kuringaniza neza imiterere yururimi rwateganijwe hamwe na SAM kugirango ubone rusange rusange kuri datasets ntoya.

Guhuza neza imiterere yururimi rwateganijwe hamwe na SAM kugirango barusheho kumenyekana neza kuri datasets ntoya yo hepfo Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.

Gukarishye-Kumenya Kugabanuka mubikorwa

Gukoresha variant ya ESAM cyangwa LookSAM mugihe ibiciro byikubye kabiri bya vanilla SAM bihenze cyane.

Gukoresha variant ya ESAM cyangwa LookSAM mugihe ibiciro byikubye kabiri bya vanilla SAM bihenze cyane Amakipe akunze kubona umusaruro mwiza mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

!

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

!

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi