Gufata-no-Kwishima
Guhagarika-no-Kwishima (SE) reka reka umuyoboro wemeza wige uburemere bwibintu byose biranga umuyoboro, ubisubiremo ukurikije imiterere yisi.
Incamake
This cheap attention-like mechanism won the 2017 ImageNet competition and became a standard CNN building block.
Kwibira cyane
Byerekanwe na Hu, Shen, na Sun muri 2017, blok ya SE yongeraho umurongo wa CNN kuri CNN. Ikora mu ntambwe ebyiri. 'Gucisha bugufi' ikoresha impuzandengo yisi yose kugirango isenyure buri karita yerekana (uburebure bwa x ubugari) mumubare umwe, itanga ibisobanuro kuri buri muyoboro uvuga muri make ibikorwa byayo ku isi. 'Ibyishimo' bigaburira iyo vector binyuze mubice bibiri bito bihujwe byuzuye hamwe nuducupa (ReLU noneho sigmoid) kugirango bitange uburemere bwumuyoboro uri hagati ya 0 na 1. Ibyo bipimo bigwizaho ikarita yumwimerere yibiranga, byongerera imiyoboro yingirakamaro no gutesha agaciro bidafite akamaro. SENet yatsinze ikibazo cyo gushyira mu byiciro ILSVRC 2017, igabanya amakosa ya top-5 igera kuri 2,25%. Guhagarika byongeraho bike ku ijana byongeweho ibipimo na compte, hamwe nibice muri ResNet, Inception, cyangwa MobileNet hamwe nimpinduka nkeya.
Ubushishozi
Gucomeka bitanga C-uburebure bwa vector z aho z_c ni impuzandengo yumwanya wa c. Ibyishimo bibara s = sigmoid (W2 * ReLU (W1 * z)), aho W1 igabanya urugero mukigereranyo cyo kugabanya r (mubisanzwe 16) na W2 ikagarura, bigatuma igiciro cyongeweho ari gito. Ibisohoka niyinjiza ibiranga ikarita yapimwe umuyoboro-ukoresheje na s. Nuburyo bwo kwikinisha: umuyoboro uhitamo, uhereye kumibare yisi yose, imiyoboro ifite akamaro kubyo kwinjiza byihariye.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'urusobe-na-Ibyishimo
SE bloks ibaho muburyo bwububiko bunoze: EfficientNet na MobileNetV3 ibashyira mububiko bwabo. Igitekerezo cyabyaye umuryango wokwitabwaho, CBAM yongeraho umwanya, ECA-Net isimbuza icyuho hamwe na 1D ihendutse, kandi ayo mayeri yoroheje yo kwisubiramo ubu agaragara mugutahura, gutandukanya, ndetse no kuvanga ibyerekezo bihindura. Tegereza umuyoboro witonze kugirango ukomeze kugiciro gito cyukuri neza aho imyanzuro ikomeje.
Gushyira mu bikorwa Isi
SENet yatsinze ImageNet ILSVRC 2017 ikibazo cyo gutondekanya ibyiciro wongeyeho SE kuburiburi bwa ResNeXt
EfficientNet na MobileNetV3 yashyizemo modul ya SE muri buri gice kugirango izamure neza kubikoresho bigendanwa
Ibikoresho byerekana ibintu hamwe nicyitegererezo cyinjiza SE kugirango ushimangire imiyoboro yamakuru
ECA-Net na CBAM bagura igitekerezo cya SE hamwe nibihendutse cyangwa bimenyerewe muburyo butandukanye
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Squeeze-and-Excitation Networks quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Imiyoboro ya Capsule
Ibibazo bikunze kubazwa
What is Squeeze-and-Excitation Networks?
Guhagarika-no-Kwishima (SE) reka reka umuyoboro wemeza wige uburemere bwibintu byose biranga umuyoboro, ubisubiremo ukurikije imiterere yisi. Ubu buryo buhendutse bwo kwitabwaho bwatsinze amarushanwa ya ImageNet ya 2017 hanyuma buhinduka inyubako isanzwe ya CNN.
Intambwe 'gukanda' murwego rwa SE ikora iki?
Gucomeka bikoresha impuzandengo rusange yisi yose, gusenyera buri karita yikarita mubisobanuro bimwe kumuyoboro.
Niki 'kwishima' intambwe isohoka?
Ibyishimo bitambutsa icyerekezo cyanyujijwe mu byiciro bibiri bya FC bikarangirira kuri sigmoid, bitanga umurongo kuri buri munzani.
Nigute uburemere bushimishije bukoreshwa ku ikarita yumwimerere?
Ikarita iranga buri muyoboro igwizwa nuburemere bwize, kongera cyangwa guhagarika uwo muyoboro.
Kuki kwishima bikoresha icyuho gifite igipimo cyo kugabanya (akenshi 16)?
Amacupa aragabanuka noneho agarura urwego rwumuyoboro, bityo SE guhagarika igura bike gusa byiyongera.
Ni ayahe marushanwa SENet yatsinze muri 2017?
SENet yatsinze ikibazo cya ILSVRC 2017 cyo gutondekanya amashusho, itera amakosa ya top-5 kugera kuri 2,25%.