Ubuyobozi bwa tekiniki

Gufata-no-Kwishima

Guhagarika-no-Kwishima (SE) reka reka umuyoboro wemeza wige uburemere bwibintu byose biranga umuyoboro, ubisubiremo ukurikije imiterere yisi.

Incamake

Guhagarika-no-Kwishima (SE) reka reka umuyoboro wemeza wige uburemere bwibintu byose biranga umuyoboro, ubisubiremo ukurikije imiterere yisi. Ubu buryo buhendutse bwo kwitabwaho bwatsinze amarushanwa ya ImageNet ya 2017 hanyuma buhinduka inyubako isanzwe ya CNN.

Gufata-no-Kwishima Imiyoboro ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.

Kwibira cyane

Yatangijwe na Hu, Shen, nizuba muri 2017, SE SE yongeyeho umuyoboro wihariye kuri CNN. Ikora mu ntambwe ebyiri. 'Gucisha bugufi' ikoresha impuzandengo yisi yose kugirango isenyure buri karita yerekana (uburebure bwa x ubugari) mumubare umwe, itanga ibisobanuro kuri buri muyoboro uvuga muri make ibikorwa byayo ku isi. 'Ibyishimo' bigaburira iyo vector binyuze mubice bibiri bito bihujwe byuzuye hamwe nuducupa (ReLU noneho sigmoid) kugirango bitange uburemere bwumuyoboro uri hagati ya 0 na 1. Ibyo bipimo bigwizaho ikarita yumwimerere yibiranga, byongerera imiyoboro yingirakamaro no gutesha agaciro bidafite akamaro. SENet yatsinze ikibazo cyo gushyira mu byiciro ILSVRC 2017, igabanya amakosa ya top-5 igera kuri 2,25%. Guhagarika byongeraho bike ku ijana byongeweho ibipimo na compte, hamwe nibice muri ResNet, Inception, cyangwa MobileNet hamwe nimpinduka nkeya.

Ubushishozi

Gucomeka bitanga C-uburebure bwa z aho z_c ni ikigereranyo cyumwanya wumuyoboro c. Ibyishimo bibara s = sigmoid (W2 * ReLU (W1 * z)), aho W1 igabanya urugero mukigereranyo cyo kugabanya r (mubisanzwe 16) na W2 ikagarura, bigatuma igiciro cyongeweho ari gito. Ibisohoka niyinjiza ibiranga ikarita yapimwe umuyoboro-ukoresheje na s. Nuburyo bwo kwikinisha: umuyoboro uhitamo, uhereye kumibare yisi yose, imiyoboro ifite akamaro kubyo kwinjiza byihariye.

Kumenya guhuza imiyoboro-no-Kwishima

Guhagarika-no-Kwishima (SE) reka reka umuyoboro wemeza wige uburemere bwibintu byose biranga umuyoboro, ubisubiremo ukurikije imiterere yisi. Ubu buryo buhendutse bwo kwitabwaho bwatsinze amarushanwa ya ImageNet ya 2017 hanyuma buhinduka inyubako isanzwe ya CNN. Gufata-no-Kwishima Imiyoboro ni inyubako ya tekiniki yubaka igira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata imiyoboro ya Squeeze-na-Ibyishimo nkurugero rwimikorere, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mubimenyerezo, amakipe akomeye akoresha Squeeze-na-Ibyishimo Byimikorere ihuza imyubakire, amakuru, nibikorwa byo guhitamo ibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza Kumuyoboro-no-Kwishima

SE bloks ibaho muburyo bwububiko bunoze: EfficientNet na MobileNetV3 ibashyira mububiko bwabo. Igitekerezo cyabyaye umuryango wokwitabwaho, CBAM yongeraho umwanya, ECA-Net isimbuza icyuho hamwe na 1D ihendutse, kandi ayo mayeri yoroheje yo kwisubiramo ubu agaragara mugutahura, gutandukanya, ndetse no kuvanga ibyerekezo bihindura. Tegereza umuyoboro witonze kugirango ukomeze kugiciro gito cyukuri neza aho imyanzuro ikomeje.

Gushyira mu bikorwa Isi

SENet yatsinze ImageNet ILSVRC 2017 ikibazo cyo gutondekanya ibyiciro wongeyeho SE kuburiburi bwa ResNeXt

EfficientNet na MobileNetV3 yashyizemo modul ya SE muri buri gice kugirango izamure neza kubikoresho bigendanwa

Ibikoresho byerekana ibintu hamwe nicyitegererezo cyinjiza SE kugirango ushimangire imiyoboro yamakuru

ECA-Net na CBAM bagura igitekerezo cya SE hamwe nibihendutse cyangwa bimenyerewe muburyo butandukanye

Uburyo bwo Gushyira mu bikorwa

Gufata-no-Kwishima Imiyoboro

SENet yatsinze ImageNet ILSVRC 2017 ikibazo cyo gutondekanya ibyiciro wongeyeho SE kuburiburi bwa ResNeXt.

SENet yatsinze ImageNet ILSVRC 2017 ikibazo cyo gushyira mubyiciro byongeweho SE kubitsinda ryumugongo wa ResNeXt ubusanzwe ibona umusaruro ushimishije mugihe isobanura ibipimo ngenderwaho byimbere imbere, igakomeza inzira yo kuzamura abantu kubibazo, kandi ikurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Gufata-no-Kwishima Imiyoboro

EfficientNet na MobileNetV3 yashyizemo modul ya SE muri buri gice kugirango izamure neza kubikoresho bigendanwa.

EfficientNet na MobileNetV3 yashyizemo modul ya SE muri buri gice kugirango yongere ubunyangamugayo kubikoresho bigendanwa Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

Gufata-no-Kwishima Imiyoboro

Ibikoresho byerekana ibintu hamwe nicyitegererezo cyinjiza SE kugirango ushimangire imiyoboro yamakuru.

Ibikoresho byerekana ibintu hamwe nibice byinjizamo SE kugirango ushimangire imiyoboro yerekana amakuru Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Gufata-no-Kwishima Imiyoboro

ECA-Net na CBAM bagura igitekerezo cya SE hamwe nibihendutse cyangwa bimenyerewe muburyo butandukanye.

ECA-Net na CBAM byongerera igitekerezo cya SE hamwe nibihendutse cyangwa byamenyekanye muburyo bwo guhuza imiyoboro Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

!

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

!

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi