Ubuyobozi bwa tekiniki

Kugabanuka-Kumenya Kugabanuka

Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza Kukarishye-Kumenya Kugabanuka
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Flatter minima tend to generalize better, so SAM often improves test accuracy and robustness without changing the model architecture.

Kwibira cyane

Amahugurwa asanzwe agabanya igihombo kumwanya umwe muburemere, ariko ibisubizo bibiri hamwe no gutakaza imyitozo imwe birashobora kwitwara muburyo butandukanye: byibuze 'umuto' muto wicaye mukibaya kigufi aho uburemere buke butera igihombo, mugihe byibuze 'igorofa' yihanganira kwangirika kandi mubisanzwe muri rusange nibyiza bitagaragara. SAM, yatangijwe na Google abashakashatsi muri 2020, irabigaragaza neza. Kuri buri ntambwe ibanza kubona uburemere bwegereye (muri radiyo ntoya rho) bugabanya cyane igihombo - umuturanyi mubi-mubi - hanyuma akavugurura uburemere bwumwimerere kugirango agabanye igihombo kuri iyo ngingo. Iyi min-max intego itera gusunikisha uturere turi hasi cyane, bitanga umusaruro ugaragara muburyo rusange bwo gushushanya amashusho no hanze yacyo.

Gushyira mu bikorwa Isi

Kuzamura Vision Transformer hamwe na ResNet neza kuri ImageNet mumahugurwa hamwe na SAM aho kuba SGD isanzwe.

Kunoza imbaraga zo kuranga urusaku, kuva minima iringaniye ntibishobora gufata mu mutwe ibirango byangiritse.

Kuringaniza neza imvugo yindimi yateguwe hamwe na SAM kugirango ubone neza rusange kuri datasets ntoya.

Gukoresha variant ya ESAM cyangwa LookSAM mugihe ibiciro byikubye kabiri bya vanilla SAM bihenze cyane.

Kazoza Kukarishye-Kumenya Kugabanuka

SAM yabyaye umuryango wabakurikirana ugamije intege nke zawo, kubara kabiri: impinduka nziza nka ESAM, LookSAM, nuburyo bukoresha agace gato k'ibiro cyangwa ugakoresha SAM buri ntambwe nkeya. Adaptive SAM (ASAM) isubiramo radiyo kugirango ibe igipimo-kidahinduka. Abashakashatsi bakomeje kujya impaka neza impamvu uburinganire bufasha nuburyo bwo kubipima, kandi ibitekerezo-bikarishye bikwirakwira muguhuza neza imvugo nini yindimi no kunoza imbaraga zo guhinduranya.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Sharpness-Aware Minimization quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Sharpness-Aware Minimization?

Gukarishye-Kumenya Kugabanya (SAM) nuburyo bwiza bwo gushakisha uburyo budashaka igihombo gito gusa ahubwo igihombo gito mukarere kose kapima ibiro - byibuze. Flatter minima ikunda kuba rusange muri rusange, SAM rero ikunze kunoza ikizamini cyukuri no gukomera udahinduye imiterere yicyitegererezo.

Ni ubuhe bwoko bwa SAM igerageza kubona?

SAM yibasiye minima iringaniye kuko igihombo gikomeza kuba gito munsi yuburemere buke bukunze kuba rusange muburyo bwiza butagaragara.

Nibangahe imbere-gusubira inyuma intambwe isanzwe ya SAM isaba?

SAM ibara icyiciro kugirango ibone ikibazo-kibabaje hafi, hanyuma ikindi gipimo gihari cyo kuvugurura - hafi inshuro ebyiri igiciro gisanzwe.

Niki radiyo hyperparameter rho igenzura muri SAM?

Rho ashyiraho intera 'kuzamuka' igenda ishakisha umuturanyi mubi cyane, asobanura akarere kanini SAM ishaka.

Niyihe yambere mu ntambwe ebyiri za SAM kuri buri itera?

SAM ibanza guhuza uburemere buri muri radiyo rho mu cyerekezo cyerekana igihombo kinini, hanyuma ikamanuka uhereye kumwanya wambere ukoresheje gradient ibarwa hariya.

Kuki SAM ikunze kunoza imbaraga zo kuranga urusaku?

Gufata mu mutwe ibirango bisakuza mubisanzwe bisaba minima ityaye, ifunganye; mugutonesha uturere turinganiye, SAM irwanya ibyo birenze.