Uhlolojikelele
Amabhulokhi we-Squee-and-Excitation (SE) avumela inethiwekhi ye-convolutional ukuthi ifunde ukuthi isiteshi ngasinye sesici singasikala kangakanani, sisilinganise kabusha ngokusekelwe kumongo womhlaba. Le nqubo eshibhile efana nokunakwa iwine umncintiswano we-ImageNet ka-2017 futhi yaba ibhulokhi yokwakha evamile ye-CNN.
Amanethiwekhi Wokuminyanisa-Ne-Excitation iyibhulokhi yokwakha yobuchwepheshe ethinta ikhwalithi yemodeli, izindleko zengqalasizinda, ukubambezeleka, nokuthembeka esikalini.
I-Deep Dive
Yethulwe ngu-Hu, Shen, kanye neLanga ngo-2017, i-SE block yengeza ukunakwa kwesiteshi okusobala ku-CNN. Isebenza ngezinyathelo ezimbili. 'Ukuminyanisa' kusebenzisa ukuhlanganisa okumaphakathi komhlaba wonke ukuze kugoqwe imephu yesici ngasinye (ubude x ububanzi) ibe inombolo eyodwa, okukhiqiza incazelo eyodwa yesiteshi ngasinye efingqa ukwenziwa kwayo kusebenze emhlabeni jikelele. 'I-excitation' iphakela leyo ivekhtha ngezandlalelo ezimbili ezincane ezixhunywe ngokugcwele nge-bottleneck (i-ReLU bese i-sigmoid) ukuze kukhiqizwe isisindo somzila ngamunye phakathi kuka-0 no-1. Lezo zisindo ziphindaphinda amamephu wesici sangempela, zikhulise iziteshi eziwusizo futhi zidambise ezingabalulekile. I-SENet iwine inselele yokuhlukaniswa kwe-ILSVRC 2017, yehlisa iphutha eli-5 eliphezulu laya cishe ku-2.25%. Ibhulokhi ingeza amaphesenti ambalwa kuphela amapharamitha engeziwe kanye nokubala, futhi ingena ku-ResNet, Inception, noma i-MobileNet enoshintsho oluncane.
I-Technical Insight
Ukuminyanisa kukhiqiza ivekhtha engu-C yobude lapho i-z_c iyisilinganiso sendawo sesiteshi c. I-excitation computes s = sigmoid(W2 * ReLU(W1 * z)), lapho i-W1 yehlisa ubukhulu ngenani lokunciphisa u-r (ngokuvamile u-16) futhi i-W2 iyibuyisela, igcina izindleko ezingeziwe zizincane. Okukhiphayo kuyisici semephu yesici esikalwa ngobuhlakani besiteshi ngo-s. Kuwuhlobo lokuzigaxa wena ngokwakho: inethiwekhi iyanquma, kusukela kuzibalo zomhlaba, ukuthi yiziphi iziteshi ezibalulekile kulokhu kufaka phakathi.
Ukwazi Amanethiwekhi Wokukhama kanye Nenjabulo
Amabhulokhi we-Squee-and-Excitation (SE) avumela inethiwekhi ye-convolutional ukuthi ifunde ukuthi isiteshi ngasinye sesici singasikala kangakanani, sisilinganise kabusha ngokusekelwe kumongo womhlaba. Le nqubo eshibhile efana nokunakwa iwine umncintiswano we-ImageNet ka-2017 futhi yaba ibhulokhi yokwakha evamile ye-CNN. Amanethiwekhi Wokuminyanisa-Ne-Excitation iyibhulokhi yokwakha yobuchwepheshe ethinta ikhwalithi yemodeli, izindleko zengqalasizinda, ukubambezeleka, nokuthembeka esikalini. Ukuze wakhe ukuqonda okujulile, phatha Amanethiwekhi E-Squeeze-and-Excitation njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa Amanethiwekhi E-Squeeze-and-Excitation alungiselela izakhiwo, idatha, nokukhetha kwengqalasizinda ngokumelene nokuthembeka nezindleko. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka. Ngesikhathi esifanayo, Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka.
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha.
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni.
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
I-SENet iwine inselele yokuhlukaniswa kwe-ImageNet ILSVRC 2017 ngokwengeza amabhlogo we-SE kumgogodla we-ResNeXt
I-EfficientNet ne-MobileNetV3 zishumeka amamojula e-SE kuwo wonke amabhulokhi ukuze kukhuliswe ukunemba kumadivayisi eselula
Izitholi zezinto namamodeli okuhlukanisa afaka amabhulokhi e-SE ukuze agcizelele iziteshi zezici ezifundisayo
I-ECA-Net kanye ne-CBAM banweba umbono we-SE ngokulungiswa kabusha kwesiteshi okushibhile noma okuqaphela indawo
Amaphethini Okusebenzisa
Amanethiwekhi okucindezela nokuvusa amadlingozi ayasebenza
I-SENet iwine inselele yokuhlukaniswa kwe-ImageNet ILSVRC 2017 ngokwengeza amabhulokhi e-SE kumgogodla we-ResNeXt.
I-SENet iwine inselele yokuhlukaniswa kwe-ImageNet ILSVRC 2017 ngokwengeza amabhulokhi e-SE ku-backbone Teams ye-ResNeXt ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amanethiwekhi okucindezela nokuvusa amadlingozi ayasebenza
I-EfficientNet ne-MobileNetV3 zishumeka amamojula e-SE kuwo wonke amabhulokhi ukuze kukhuliswe ukunemba kumadivayisi eselula.
I-EfficientNet kanye ne-MobileNetV3 ishumeka amamojula we-SE kuwo wonke amabhulokhi ukuze kukhuliswe ukunemba kumadivayisi eselula Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amanethiwekhi okucindezela nokuvusa amadlingozi ayasebenza
Izitholi zezinto namamodeli okuhlukanisa afaka amabhulokhi e-SE ukuze agcizelele iziteshi zezici ezifundisayo.
Izitholi zezinto namamodeli okuhlukanisa afaka amabhulokhi e-SE ukuze agcizelele amashaneli ezici ezifundisayo Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amanethiwekhi okucindezela nokuvusa amadlingozi ayasebenza
I-ECA-Net kanye ne-CBAM banweba umbono we-SE ngokulungiswa kabusha kwesiteshi okushibhile noma okuqaphela indawo.
I-ECA-Net kanye ne-CBAM banweba umbono we-SE ngamaThimba okuhlaziya amashaneli ashibhile noma aqaphela indawo ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka kwabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu.
Izindleko zengqalasizinda nezokulungisa zivame ukubukelwa phansi.
Izikhala zokuphepha nokubonakala zingakhula njengoba izinhlelo ziba nzima kakhulu.
Ukuqalisa Umhlahlandlela
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa.
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.