InoteveraGaidhi rinotevera
Highway Networks uye Skip Connections
Tekinoroji
Nhungamiro yehunyanzvi
Capsule network ndeye neural architecture iyo inounganidza neuroni kuita 'capsules' inoburitsa mavector encoding zvese kana chinhu chiripo uye chimiro chayo (chinzvimbo, kutarisisa, chikero).
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
They aim to fix a core blindness in standard convolutional networks: losing track of spatial relationships between parts.
Yakakurudzirwa naGeoffrey Hinton, Sara Sabour, naNicholas Frosst muna 2017, capsule network inotsiva scalar neuron kubuda nevector. Kureba kwevekitari kunomiririra mukana wekuti chimwe chinhu (seziso kana mhino) chiripo, ukuwo maencodes acho anoisa paramita. Yepasi-level capsules inofanotaura mamiriro epamusoro-level capsules kuburikidza neshanduko matrices, uye maitiro anonzi dynamic routing-by-chibvumirano chinosarudza kuti ndedzipi fungidziro yekuvimba. Kana akawanda ma-capsules akabvumirana pane imwechete yese, nzira inosimbisa iyo kubatana. Iyo yekutanga CapsNet yakawana mhedzisiro yakasimba paMNIST uye yaive yakasimba kune anopindirana manhamba uye affine shanduko, kugadzirisa 'dambudziko rePicasso' apo CNNs inobvuma maficha akavhiringika kumeso sechiso chakasimba.
Kurongedza manhamba akanyorwa nemaoko paMNIST uku uchigadzira patsva kubva kumacapsule vectors, zvichitaridza mapose paramita ane zvazvinoreva.
Kupatsanura manhamba maviri anopindirana (basa reMultiMNIST) nekupatsanura kuti mapikseli ndeapi ndeesangano ripi.
Tsvagiridzo yekufungidzira kwekurapa uchishandisa makapulisi kuona mazamu emapapu kana mabundu ehuropi apo hukama hwepakati-hwese hune basa.
Kuziva zvinhu kubva pamaonero ezvitsva nemienzaniso mishoma yekudzidziswa, kusimudzira iyo yakavakirwa-mukati maonero equivariance.
Capsule network inoramba iri nzira yekutsvagisa pane yakaisirwa chiyero, zvakanyanya nekuti ine simba nzira inodhura computationally uye zviyero zvisina kunaka kumifananidzo mikuru seImageNet. Gare gare basa rakaongorora EM routing (Matrix Capsules) uye yekuzvitarisa-yakavakirwa nzira yekuvandudza kugona. Sezvo kufarira kuenzana, kushanda zvakanaka kwemuenzaniso, uye kududzira chikamu-chese hierarchies ichikura, pfungwa dzekapule dzinoramba dzichipesvedzera tsvakiridzo, kusanganisira yaHinton yakazotevera GLOM chikumbiro, kunyangwe seTransformers inotonga maonero makuru.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Capsule network ndeye neural architecture iyo inounganidza neuroni kuita 'capsules' inoburitsa mavector encoding zvese kana chinhu chiripo uye chimiro chayo (chinzvimbo, kutarisisa, chikero). Ivo vanovavarira kugadzirisa hupofu hwepakati mune yakajairwa convolutional network: kurasikirwa netrack yehukama hwepakati pakati pezvikamu.
Kureba kwevhekita (hukuru) kunoisa mukana wekuti sangano rivepo, ukuwo marongero aro ekodhi achiisa zvimiro zvakaita senzvimbo uye kutenderera.
MaCNN ane max-pooling anorasa hukama chaihwo hwenzvimbo, saka chiso chine maficha akarasika chinogona kuramba chiripo. Iyi ndiyo 'Picasso dambudziko' capsules edza kugadzirisa.
Dynamic routing-by-chibvumirano inosimbisa hukama pakati pemakapisi ane fungidziro inobvumirana nekubuda kwekapisi yepamusoro.
Bepa ra2017 'Dynamic Routing Between Capsules' rakanyorwa naSara Sabour, Nicholas Frosst, naGeoffrey Hinton.
Iyo squash nonlinearity inodzika mavheji mapfupi kuenda ku zero uye inovhara mavheji marefu padhuze nehurefu hwekutanga, saka ukuru hunogona kuverengeka semukana apo kutarisisa (pose) kwakachengetedzwa.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Highway Networks uye Skip Connections
Tekinoroji