HAGAHA Farsamada

Isku-xidhka-iyo-Xoojinta Shabakadaha

Squeeze-and-Excitation (SE) blocks waxay u oggolaadaan shabakada isdhexgalka inay bartaan inta ay le'eg tahay miisaanka sifada kanaal kasta, iyaga oo dib u habeynaya iyaga oo ku saleysan macnaha guud.

2 daqiiqo akhriMarkii u dambaysay ee la cusbooneysiiyay

Dulmar

This cheap attention-like mechanism won the 2017 ImageNet competition and became a standard CNN building block.

quusid qoto dheer

Waxaa soo bandhigay Hu, Shen, iyo Sun 2017, block SE wuxuu ku darayaa dareenka kanaalka cad CNN. Waxay u shaqeysaa laba tallaabo. 'Cujuujintu' waxay isticmaashaa isku geynta celceliska caalamiga ah si ay u burburiso khariidad kasta oo muuqaal ah (dhererka x ballaca) oo la geliyo hal lambar, iyada oo soo saarta hal tilmaame kanaal kasta oo soo koobaya firfircoonidiisa caalamiga ah. 'Xiriirta' waxay quudinaysaa in vector iyada oo loo marayo laba lakab oo yaryar oo si buuxda isugu xidhan oo leh qoor dhalo (ReLU ka dibna sigmoid) si loo soo saaro miisaanka kanaalka inta u dhaxaysa 0 iyo 1. Miisaanadaasi waxay badiyaan khariidadaha muuqaalka asalka ah, kor u qaadaya kanaalada waxtarka leh iyo qoyaan kuwa aan khusayn. SENet waxay ku guulaysatay loolanka kala soocida ILSVRC 2017, iyada oo jaray khaladka 5 ee ugu sarreeya ilaa 2.25%. Balooggu waxa uu ku daraa oo kaliya dhawr boqol oo qiyaaso dheeraad ah oo xisaabiya, iyo boosaska ResNet, Inception, ama MobileNet oo leh isbeddel yar.

Aragtida Farsamada

Tuujintu waxay soo saartaa C-dhererka vector z halkaasoo z_c uu yahay celceliska boosaska kanaalka c. Xisaabinta xiisaha s = sigmoid (W2 * ReLU(W1 * z)), halkaas oo W1 ay ku yarayso cabbirka hoos u dhigista saamiga r (caadi ahaan 16) iyo W2 ayaa dib u soo celinaysa, iyada oo ilaalinaysa kharashka dheeraadka ah. Wax soo saarku waa khariidadda sifada gelinta ee la miisaamay kanaalka-xikmad leh ee s. Waa nooc ka mid ah is-gating: shabakadu waxay go'aamisaa, laga soo bilaabo tirakoobyada caalamiga ah, kanaalada muhiimka u ah gelintan gaarka ah.

Saamaynta Istiraatijiyadeed

Qiimaha iyo miisaaniyada

Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.

Go'aamo cad

Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.

Xakamaynta tayada

Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.

Mustaqbalka Isku-xidhka-iyo-Xoojinta Shabakadaha

SE blocks waxay ku nool yihiin gudaha dhismooyin hufan: EfficientNet iyo MobileNetV3 waxay ku dhejiyeen dhismooyinkooda. Fikradda ayaa soo saartay qoys ka mid ah qaybaha dareenka, CBAM waxay ku darsataa dareenka goobta, ECA-Net waxay ku beddeshaa dhalooyinka iyada oo la adeegsanayo isbeddel 1D ah oo raqiis ah, iyo farsamooyinka dib u habeynta khafiifka ah waxay hadda u muuqdaan ogaanshaha, qaybinta, iyo xitaa qaar ka mid ah isku-dhafka aragga-beddelka. Filo dareenka kanaalka in uu ahaado kabaal sax ah oo jaban meel kasta oo qalalaasuhu ka jiraan.

Dhaqangelinta Adduunka-dhabta ah

SENet waxay ku guulaysatay loolankii kala soocida ImageNet ILSVRC 2017 iyadoo ku dartay baloogyada SE laf dhabarta ResNeXt

EfficientNet iyo MobileNetV3 waxay ku dhejiyaan modules SE qayb kasta si kor loogu qaado saxnaanta aaladaha moobaylka

Qalabka sheyga iyo moodooyinka kala qaybinta waxay geliyaan SE blocks si ay u xoojiyaan kanaalada muuqaalka macluumaadka

ECA-Net iyo CBAM waxay ku kordhiyaan fikradda SE iyadoo la raacayo dib-u-habaynta kanaalka ka jaban ama ka warqabka

Khatarta & Dariiqyada Ilaalada

Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.

Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.

Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.

Qorshe Hawleedka Dhaqangelinta

1

Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.

2

Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.

3

La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.

4

U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.

Sii wad Sahaminta

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Squeeze-and-Excitation Networks quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Bilow kedis

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Hagaha xiga

Shabakadaha Kaabsoosha

Su'aalaha soo noqnoqda

What is Squeeze-and-Excitation Networks?

Squeeze-and-Excitation (SE) blocks waxay u oggolaadaan shabakada isdhexgalka inay bartaan inta ay le'eg tahay miisaanka sifada kanaal kasta, iyaga oo dib u habeynaya iyaga oo ku saleysan macnaha guud. Habkan dareenka jaban ee u eg wuxuu ku guuleystey tartanka ImageNet 2017 wuxuuna noqday halbeegga dhismaha CNN.

Maxay qabtaa tallaabada ' tuujin' ee block SE?

Tuujintu waxay khusaysaa isku geynta celceliska caalamiga ah, iyada oo ku duminaysa khariidad sifada mid kasta oo sharraxaysa kanaalkiiba.

Waa maxay soo-saarka tillaabada 'excitation'?

Xamaasadu waxay u gudubtaa vector-ka la tuujiyey laba lakab oo FC ah oo ku dhammaanaya sigmoid, taasoo keenta miisaanyo isku-dheellitir ah-kannel kasta.

Sidee miisaanka xamaasadda loogu dabaqay khariidadaha muuqaalka asalka ah?

Khariidadda muuqaalka kanaal kasta waxaa lagu dhuftaa miisaankiisa la bartay, kor u qaadaya ama xakamaynaya kanaalkaas.

Waa maxay sababta xamaasadu u isticmaasho qoorta dhalo leh saamiga dhimista (badanaa 16)?

Qoorta dhaladu way sii yaraanaysaa ka dibna waxay soo celisaa cabbirka kanaalka, markaa xannibaadda SE waxay ku kacaysaa kaliya dhowr boqolkiiba dheeraad ah.

Waa maxay tartanka SENet ku guulaysatay 2017?

SENet waxay ku guulaysatay loolankii kala soocida sawirka ILSVRC 2017, iyada oo ku riixaysa qaladka 5-aad ilaa 2.25%.