Ngokujulile Separable Convolutions
Ukujula okuhlukanisekayo kuhlanganisa ukuguquguquka okujwayelekile kube izinyathelo ezimbili ezishibhile, kunqamula inani lokuphindaphinda namapharamitha.
Uhlolojikelele
They are the trick that lets neural networks run on phones and edge devices without melting the battery.
I-Deep Dive
I-convolution evamile ihlanganisa ulwazi kuzo zombili isikhala namashaneli ekusebenzeni okukodwa okuminyene, okumba eqolo. I-convolution ehlukene ejulile ihlukanisa lokhu kube izigaba ezimbili. Okokuqala, isinyathelo esifinyelela ukujula sisebenzisa isihlungi esisodwa esincane ngeshaneli ngayinye yokufaka ngokuzimela, sithwebula amaphethini wendawo ngaphakathi kwesiteshi ngasinye kodwa singahlanganisi amashaneli. Okwesibili, isinyathelo esiphusile sisebenzisa i-1x1 convolution ukuhlanganisa iziteshi kuphikseli ngayinye, ukuxuba ulwazi lwesiteshi ngaphandle kokubheka omakhelwane. Ngokuhlanganisa ukuhlunga kwendawo ekuxubeni kwesiteshi, isamba sekhompiyutha sehla kakhulu, ngokuvamile izikhathi eziyisi-8 kuye kweziyi-9 kusihlungi esingu-3x3, ngokulahleka kokunemba okuncane kuphela. Le factorization ingumgogodla we-MobileNet kanye ne-Xception.
I-Technical Insight
Kumashaneli okokufaka wemephu engu-3x3 kernel M kuya kokuphumayo kuka-N phezu kwemephu yesici, ukuguqulwa okujwayelekile kubiza cishe izikhathi ezingu-9 M izikhathi ezingu-N zokuphindaphinda-kwengeza indawo ngayinye. Inguqulo ehlukanisekayo ibiza izikhathi ezingu-9 M ngengxenye ejulile kanye no-M izikhathi ezingu-N kokungu-1x1 okuqondile. Isilinganiso sicishe sibe ngu-1/N + 1/9, ngakho-ke ku-N enkulu ukonga kusondela ku-1/9 isici sendawo.
I-Strategic Impact
Izindleko kanye nesabelomali
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka.
Izinqumo ezicacile
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha.
Ukulawulwa kwekhwalithi
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni.
Ikusasa Lokuguquguquka Okuhlukaniseka Ngokujulile
Ama-convolutions ahlukaniseke ngokujulile ahlala eyisisekelo samamodeli ombono asebenza kahle futhi aya ngokuya avela kumiklamo eyingxube ye-CNN-transformer efana namabhulokhi e-MobileViT kanye ne-ConvNeXt. Njengoba i-AI ekudivayisi ikhula, izisheshisi zehadiwe zengeza usekelo lwendabuko lwama-ops ajulile. Lindela ukusetshenziswa okuqhubekayo ekuboneni kwesikhathi sangempela, izinzwa ezigqokekayo, nanoma isiphi isilungiselelo lapho ukubambezeleka, inkumbulo, nesabelomali samandla kuqinile, ngokuvamile kuhlanganiswe nosesho lwe-quantization kanye ne-neural architecture.
Ukuqaliswa Komhlaba Wangempela
I-MobileNet kanye ne-MobileNetV2 bayisebenzisela ukusebenzisa ukuhlukaniswa kwezithombe ngokuqondile kuma-smartphones ane-latency encane
Isegimenti yesikhathi sangempela sokuma ngobude nokufiphala kwengemuva ezinhlelweni zokusebenza zokushaya ngevidiyo kuncike emigogodlweni engasindi ehlukanisekayo
Ukutholwa kwento ekudivayisi kumakhamera okuvikela nama-drones, lapho amandla nekhompyutha kunqunyelwe khona
I-Xception iwasebenzisa esikalini ukuze iphushe ukunemba kwe-ImageNet kuyilapho ilawula ukubalwa kwepharamitha
Izingozi & Guardrails
Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu.
Izindleko zengqalasizinda nezokulungisa zivame ukubukelwa phansi.
Izikhala zokuphepha nokubonakala zingakhula njengoba izinhlelo ziba nzima kakhulu.
Ukuqalisa Umhlahlandlela
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Depthwise Separable Convolutions quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-Deformable Convolutions
Imibuzo evame ukubuzwa
What is Depthwise Separable Convolutions?
Ukujula okuhlukanisekayo kuhlanganisa ukuguquguquka okujwayelekile kube izinyathelo ezimbili ezishibhile, kunqamula inani lokuphindaphinda namapharamitha. Ziyiqhinga elivumela amanethiwekhi e-neural ukuthi asebenze kumafoni nakumadivayisi asemaphethelweni ngaphandle kokuncibilikisa ibhethri.
Yiziphi izinyathelo ezimbili uguquko oluhlukaniseke ngokujula oluhlukanisela kuzo ukuguqulwa okujwayelekile?
Isinyathelo esijulile sihlunga isiteshi ngasinye ngokwendawo ngokwaso, futhi isinyathelo esingu-1x1 esiqondile sibe sihlanganisa ulwazi kuwo wonke amashaneli.
Esinyathelweni esijulile, iziteshi zokufaka ziphathwa kanjani?
I-Depthwise convolution isebenzisa isihlungi sendawo esihlukile esiteshini ngasinye sokufaka ngaphandle kokuxuba amashaneli, okuyikhona okwenza sishibhe.
Cishe ingakanani i-convolution engahlukaniseka engu-3x3 ejule inganciphisa ukubala uma kuqhathaniswa ne-convolution evamile engu-3x3 enamashaneli okukhiphayo amaningi?
Ku-3x3 kernel isilinganiso sokulondoloza sisondela ku-1/9 lapho inani lamashaneli okukhiphayo likhulu, linikeza cishe ukusebenza okuphindwe ka-8 kuya kwezingu-9 okumbalwa.
Ithini indima ye-pointwise (1x1) convolution kulo mklamo?
I-convolution ye-1x1 pointwise ihlanganisa iziteshi kuwo wonke amaphikseli, okuyinto isinyathelo esijule esigweme ukwenziwa ngamabomu.
Iyiphi i-architecture eyaziwayo eyaduma ama-convolutions ahlukanisekayo ajulile kumadivayisi eselula?
I-MobileNet yakhiwe phakathi kwama-convolutions ahlukanisekayo ajulile ukuze inike amandla ukucatshangelwa okusebenzayo kumafoni.