Nhungamiro yehunyanzvi

Capsule Networks

Capsule network ndeye neural architecture iyo inounganidza neuroni kuita 'capsules' inoburitsa mavector encoding zvese kana chinhu chiripo uye chimiro chayo (chinzvimbo, kutarisisa, chikero).

2 min verengaLast update

Pfupiso

They aim to fix a core blindness in standard convolutional networks: losing track of spatial relationships between parts.

Kudzika Kwakadzika

Yakakurudzirwa naGeoffrey Hinton, Sara Sabour, naNicholas Frosst muna 2017, capsule network inotsiva scalar neuron kubuda nevector. Kureba kwevekitari kunomiririra mukana wekuti chimwe chinhu (seziso kana mhino) chiripo, ukuwo maencodes acho anoisa paramita. Yepasi-level capsules inofanotaura mamiriro epamusoro-level capsules kuburikidza neshanduko matrices, uye maitiro anonzi dynamic routing-by-chibvumirano chinosarudza kuti ndedzipi fungidziro yekuvimba. Kana akawanda ma-capsules akabvumirana pane imwechete yese, nzira inosimbisa iyo kubatana. Iyo yekutanga CapsNet yakawana mhedzisiro yakasimba paMNIST uye yaive yakasimba kune anopindirana manhamba uye affine shanduko, kugadzirisa 'dambudziko rePicasso' apo CNNs inobvuma maficha akavhiringika kumeso sechiso chakasimba.

Technical Insight

Iyo kiyi nzira ndeye 'squash' isiri yemutsara iyo inomisikidza mavekita mapfupi kuenda ku zero uye mavekita marefu kuenda kureba imwe, saka vector magnitude inoverengwa semukana. Dynamic routing yobva yamhanyisa mashoma edanho rechibvumirano chakaremerwa: yega yega yepasi capsule inotumira fungidziro yayo kumusoro, uye coupling coefficients inowedzera kumakapisi epamusoro ayo anobuda anoenderana (kuburikidza nedoti chigadzirwa) nekufanotaura ikoko. Izvi zvinotsiva max-pooling, kuchengetedza ruzivo chairwo rwenzvimbo panzvimbo pekuirasa.

Strategic Impact

Mutengo uye bhajeti

Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.

Sarudzo dzakajeka

Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.

Kudzora kwemhando yepamusoro

Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Ramangwana reCapsule Networks

Capsule network inoramba iri nzira yekutsvagisa pane yakaisirwa chiyero, zvakanyanya nekuti ine simba nzira inodhura computationally uye zviyero zvisina kunaka kumifananidzo mikuru seImageNet. Gare gare basa rakaongorora EM routing (Matrix Capsules) uye yekuzvitarisa-yakavakirwa nzira yekuvandudza kugona. Sezvo kufarira kuenzana, kushanda zvakanaka kwemuenzaniso, uye kududzira chikamu-chese hierarchies ichikura, pfungwa dzekapule dzinoramba dzichipesvedzera tsvakiridzo, kusanganisira yaHinton yakazotevera GLOM chikumbiro, kunyangwe seTransformers inotonga maonero makuru.

Real-World Implementation

Kurongedza manhamba akanyorwa nemaoko paMNIST uku uchigadzira patsva kubva kumacapsule vectors, zvichitaridza mapose paramita ane zvazvinoreva.

Kupatsanura manhamba maviri anopindirana (basa reMultiMNIST) nekupatsanura kuti mapikseli ndeapi ndeesangano ripi.

Tsvagiridzo yekufungidzira kwekurapa uchishandisa makapulisi kuona mazamu emapapu kana mabundu ehuropi apo hukama hwepakati-hwese hune basa.

Kuziva zvinhu kubva pamaonero ezvitsva nemienzaniso mishoma yekudzidziswa, kusimudzira iyo yakavakirwa-mukati maonero equivariance.

Njodzi & Guardrails

Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.

Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.

Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Implementation Roadmap

1

Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.

2

Benchmark pasi pechokwadi mutoro uye data mamiriro.

3

Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.

4

Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Capsule Networks quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tanga mibvunzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Gaidhi rinotevera

Highway Networks uye Skip Connections

Mibvunzo inowanzo bvunzwa

What is Capsule Networks?

Capsule network ndeye neural architecture iyo inounganidza neuroni kuita 'capsules' inoburitsa mavector encoding zvese kana chinhu chiripo uye chimiro chayo (chinzvimbo, kutarisisa, chikero). Ivo vanovavarira kugadzirisa hupofu hwepakati mune yakajairwa convolutional network: kurasikirwa netrack yehukama hwepakati pakati pezvikamu.

Munetiweki yecapsule, UREFU hwekapule's output vector inomirirei?

Kureba kwevhekita (hukuru) kunoisa mukana wekuti sangano rivepo, ukuwo marongero aro ekodhi achiisa zvimiro zvakaita senzvimbo uye kutenderera.

Ndeipi dambudziko neyakajairwa CNNs yaive capsule network yakanyatso gadzirirwa kugadzirisa?

MaCNN ane max-pooling anorasa hukama chaihwo hwenzvimbo, saka chiso chine maficha akarasika chinogona kuramba chiripo. Iyi ndiyo 'Picasso dambudziko' capsules edza kugadzirisa.

Iri zita regorgorithm iro rinosarudza kuti ndeapi ezasi-level capsules anobatana neapi epamusoro-level capsules?

Dynamic routing-by-chibvumirano inosimbisa hukama pakati pemakapisi ane fungidziro inobvumirana nekubuda kwekapisi yepamusoro.

Ndiani akaunza iyo capsule network ine dynamic routing muna 2017?

Bepa ra2017 'Dynamic Routing Between Capsules' rakanyorwa naSara Sabour, Nicholas Frosst, naGeoffrey Hinton.

Chii chinangwa chebasa re'squash' mucapsule network?

Iyo squash nonlinearity inodzika mavheji mapfupi kuenda ku zero uye inovhara mavheji marefu padhuze nehurefu hwekutanga, saka ukuru hunogona kuverengeka semukana apo kutarisisa (pose) kwakachengetedzwa.