Imiyoboro Yumuhanda no Gusimbuka
Simbuka guhuza reka amakuru asimbuke ibice byashize, kandi imiyoboro nyabagendwa yari verisiyo yambere yiki gitekerezo.
Incamake
They solve the problem of training very deep networks, which paved the way for ResNets and modern deep learning.
Kwibira cyane
Mbere yo gusimbuka guhuza, gutondekanya ibice byinshi byatumye imiyoboro ikomera, ntabwo ari nziza, guhugura kuko gradients yazimye kandi ibimenyetso byangiritse. Imiyoboro minini, yatangijwe mumwaka wa 2015, yongeyeho amarembo yize agenzura umubare winjiza murwego rwahinduwe ugereranije no gutwarwa neza, byatewe na LSTM. Bidatinze, ResNets yoroshye ibi muburyo busigaye, aho urwego rwiga imikorere isigaye kandi ibisohoka byongewe mubyo winjije binyuze mumagambo ahinnye. Izi shortcuts zirema inzira itaziguye ya gradients gutembera inyuma, bigatuma bishoboka guhugura imiyoboro amagana cyangwa igihumbi cyimbitse. Kureka guhuza ubu bigaragara hose, harimo U-Nets, DenseNets, na transformateur.
Ubushishozi
Igice gisigaye kibara ibisohoka = F (x) + x, bityo umuyoboro ukeneye gusa kwiga ibisigisigi F (x) kuruta gushushanya byuzuye. Mugihe cyo gusubira inyuma kwijambo ryirangamuntu ijambo ryanyuze kuri gradients idahindutse, kuruhande rwabuze gradients. Imiyoboro nyabagendwa isanzwe hamwe n irembo rihindura T kandi itwara irembo, ibisohoka = F (x) * T (x) + x * (1 - T (x)), aho T yiga kandi iri hagati ya 0 na 1.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'imihanda nyabagendwa no gusimbuka
Gusimbuka guhuza ubu ni inyubako isanzwe aho kuba amayeri atabishaka. Buri transformateur ikoresha amasigarira asigaye hafi yibitekerezo byayo no kugaburira-imbere-sublayers, kandi bikomeza kuba ingenzi muburyo bwo gukwirakwiza, igice U-Nets, hamwe nimbonerahamwe. Ubushakashatsi bwerekana neza uburyo busanzwe bwo gushyira mubikorwa, kwigishwa kwipimisha inzira zisigaye, hamwe nubwubatsi busubirwamo busubiramo ibikorwa kugirango ubike ububiko. Igitekerezo cyibanze cyo kubika ibimenyetso muburebure bizakomeza uko moderi ikura.
Gushyira mu bikorwa Isi
ResNet-50 na ResNet-152 bakoresha shortcuts zisigaye kugirango utoze amashusho yimbitse cyane
Abahindura hamwe nururimi runini rwuzuza amasigarira asigaye hafi yo kwitabwaho no kugaburira-imbere
U-Net gusimbuka guhuza kunyura ahantu heza kuva kodegisi kugeza kuri decoder kugirango ibice byubuvuzi bigabanuke
DenseNet ihuza buri cyiciro nicyiciro cyose cyakurikiyeho, ishishikariza kongera gukoresha no koroshya umuvuduko
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Highway Networks and Skip Connections quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Imiyoboro ya Siamese hamwe nigihombo cya gatatu
Ibibazo bikunze kubazwa
What is Highway Networks and Skip Connections?
Simbuka guhuza reka amakuru asimbuke ibice byashize, kandi imiyoboro nyabagendwa yari verisiyo yambere yiki gitekerezo. Bakemura ikibazo cyamahugurwa imiyoboro yimbitse cyane, yahaye inzira ResNets hamwe no kwiga byimbitse.
Ni ikihe kibazo cyibanze gusimbuka guhuza bifasha gukemura mumiyoboro yimbitse cyane?
Mugutanga inzira zitaziguye, simbuka guhuza reka gradients nibimenyetso bitembera mumirongo yimbitse, bigatuma imiyoboro yimbitse itozwa.
Ni ubuhe buryo bwibanze busigaye bubara?
Igice gisigaye kongeramo ibyinjijwe x mubisohoka byahinduwe F (x), bityo igipande cyiga gusa ibisigaye.
Niki cyahumekeye uburyo bwo kwinjirira mumihanda minini?
Imiyoboro nyabagendwa yatijwe igitekerezo cyamarembo yize muri LSTMs kugirango igenzure umubare wamakuru ahindurwa anyuze.
Mumuyoboro munini, irembo ryo guhindura T (x) rigenzura iki?
Ibisohoka ni F (x) * T (x) + x * (1 - T (x)), T rero ihitamo uburinganire hagati yo guhindura no gutwara ibyinjijwe.
Ni ubuhe bwubatsi bugezweho bushingiye kumasigarira asigaye hafi ya sublayers?
Abahinduzi bashira amahuza asigaye hafi yabo yose hamwe no kugaburira-kugaburira nkibishushanyo bisanzwe.