Kugabanuka-Kumenya Kugabanuka
Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze.
Incamake
Flatter minima tend to generalize better, so SAM often improves test accuracy and robustness without changing the model architecture.
Kwibira cyane
Amahugurwa asanzwe agabanya igihombo kumwanya umwe muburemere, ariko ibisubizo bibiri hamwe no gutakaza imyitozo imwe birashobora kwitwara muburyo butandukanye: byibuze 'umuto' muto wicaye mukibaya kigufi aho uburemere buke butera igihombo, mugihe byibuze 'igorofa' yihanganira kwangirika kandi mubisanzwe muri rusange nibyiza bitagaragara. SAM, yatangijwe na Google abashakashatsi muri 2020, irabigaragaza neza. Kuri buri ntambwe ibanza kubona uburemere bwegereye (muri radiyo ntoya rho) bugabanya cyane igihombo - umuturanyi mubi-mubi - hanyuma akavugurura uburemere bwumwimerere kugirango agabanye igihombo kuri iyo ngingo. Iyi min-max intego itera gusunikisha uturere turi hasi cyane, bitanga umusaruro ugaragara muburyo rusange bwo gushushanya amashusho no hanze yacyo.
Ubushishozi
Buri ntambwe ya SAM ni inzira ebyiri. Ubwa mbere, ubare igipimo cyibipimo byubu hanyuma ufate 'kuzamuka' intambwe yubunini rho mu cyerekezo cya gradient kugirango ugere kubintu bibi cyane hafi. Icya kabiri, bara gradient kuri iyo ngingo ihungabanye kandi uyikoreshe kugirango uvugurure uburemere bwumwimerere. Radiyo rho igenzura uburyo umuturanyi urinda. Igiciro ni hafi ebyiri zinyuma-zisubira inyuma kuri buri ntambwe, zikubye kabiri kubara - ingenzi nyamukuru.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza Kukarishye-Kumenya Kugabanuka
SAM yabyaye umuryango wabakurikirana ugamije intege nke zawo, kubara kabiri: impinduka nziza nka ESAM, LookSAM, nuburyo bukoresha agace gato k'ibiro cyangwa ugakoresha SAM buri ntambwe nkeya. Adaptive SAM (ASAM) isubiramo radiyo kugirango ibe igipimo-kidahinduka. Abashakashatsi bakomeje kujya impaka neza impamvu uburinganire bufasha nuburyo bwo kubipima, kandi ibitekerezo-bikarishye bikwirakwira muguhuza neza imvugo nini yindimi no kunoza imbaraga zo guhinduranya.
Gushyira mu bikorwa Isi
Kuzamura Vision Transformer hamwe na ResNet neza kuri ImageNet mumahugurwa hamwe na SAM aho kuba SGD isanzwe.
Kunoza imbaraga zo kuranga urusaku, kuva minima iringaniye ntibishobora gufata mu mutwe ibirango byangiritse.
Kuringaniza neza imvugo yindimi yateguwe hamwe na SAM kugirango ubone neza rusange kuri datasets ntoya.
Gukoresha variant ya ESAM cyangwa LookSAM mugihe ibiciro byikubye kabiri bya vanilla SAM bihenze cyane.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Sharpness-Aware Minimization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Umuyoboro wuzuye kandi uhuza
Ibibazo bikunze kubazwa
What is Sharpness-Aware Minimization?
Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze. Flatter minima ikunda kuba rusange muri rusange, SAM rero ikunze kunoza ikizamini cyukuri no gukomera udahinduye imiterere yicyitegererezo.
Ni ubuhe bwoko bwa SAM igerageza kubona?
SAM yibasiye minima iringaniye kuko igihombo gikomeza kuba gito munsi yuburemere buke bukunze kuba rusange muburyo bwiza butagaragara.
Nibangahe imbere-gusubira inyuma intambwe isanzwe ya SAM isaba?
SAM ibara icyiciro kugirango ibone ikibazo-kibabaje hafi, hanyuma ikindi gipimo gihari cyo kuvugurura - hafi inshuro ebyiri igiciro gisanzwe.
Niki radiyo hyperparameter rho igenzura muri SAM?
Rho ashyiraho intera 'kuzamuka' igenda ishakisha umuturanyi mubi cyane, asobanura akarere kanini SAM ishaka.
Niyihe yambere mu ntambwe ebyiri za SAM kuri buri itera?
SAM ibanza guhuza uburemere buri muri radiyo rho mu cyerekezo cyerekana igihombo kinini, hanyuma ikamanuka uhereye kumwanya wambere ukoresheje gradient ibarwa hariya.
Kuki SAM ikunze kunoza imbaraga zo kuranga urusaku?
Gufata mu mutwe ibirango bisakuza mubisanzwe bisaba minima ityaye, ifunganye; mugutonesha uturere turinganiye, SAM irwanya ibyo birenze.