Ubuyobozi bwa tekiniki

Gutangiza ibiro

Nigute washyiraho imiyoboro itangirira uburemere mbere yo gutangira imyitozo, ishushanya cyane niba ibimenyetso na gradients bigumana ubuzima bwiza binyuze mubice byimbitse.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Igihe kizaza cyo gutangiza ibiro
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Gutangiza neza ni itandukaniro riri hagati yo guhuza byihuse nicyitegererezo kitigera cyiga.

Kwibira cyane

Mbere yo kwitoza, uburemere bwose bukenera agaciro ko gutangira. Gushira byose kuri zeru byica: uburemere bumwe butanga gradients imwe, neuron rero ntizigera itandukanya - iki nikibazo cyo guhuza ibice. Gutangiza bisanzwe bisenya guhuza, ariko igipimo gifite akamaro kanini. Nini cyane kandi ibikorwa na gradients biraturika; nto cyane kandi zirashira. Gahunda ngenderwaho ihitamo itandukaniro rishingiye ku bunini bwa layer kugirango igumane ibimenyetso bitandukanye bihoraho murwego rumwe. Xavier (Glorot) itangizwa ryibipimo bitandukanya numubare winjiza wongeyeho ibice bisohoka kandi bikwiranye na tanh na sigmoid. We (Kaiming) umunzani wo gutangiza ukurikije umubare winjiza na konte ya ReLU ikuraho kimwe cya kabiri cyinjiza, bigatuma iba igipimo cyurushundura rwimbitse rushingiye kuri ReLU na CNN. Gutangiza neza bituma imyitozo hakiri kare itajegajega kugeza igihe ibisanzwe hamwe noguhindura imihindagurikire y'ikirere bifata.

Gushyira mu bikorwa Isi

CNN ikoresha ibikorwa bya ReLU itangizwa na We yatangije kuburyo bwimbitse bwimyitozo ya gari ya moshi itabuze ibimenyetso.

Urusobe rufite ibikorwa bya tanh rukoresha intangiriro ya Xavier kugirango ibikorwa bitandukana bihamye murwego rumwe.

Injeniyeri utangiza impanuka zose kugeza kuri zeru abona urusobe rwananiwe kwiga kuko buri neuron igumaho.

Imikorere isanzwe (Kaiming ya PyTorch, imyenda ya Glorot ya Keras) ikoresha amahame yo gutangiza mu buryo bwikora mugihe urwego rwaremewe.

Igihe kizaza cyo gutangiza ibiro

Ibisanzwe bisanzwe hamwe nibisigisigi byasigaye byatumye imyitozo itumva neza itangizwa ryukuri, ariko iracyafite akamaro kumurongo wimbitse cyangwa usanzwe udafite ubusanzwe. Ubushakashatsi bufatika burimo gahunda ijyanye na transformateur no kwitabwaho, uburyo butuma imiyoboro ihugura nta nzego zisanzwe zisanzwe, hamwe na théorie nka isometrie dinamike hamwe na neural tangent kernel iteganya imyitozo kuva yatangira wenyine. Itangiriro-rishingiye ku gutangiza, rihindura umunzani uhereye ku cyitegererezo, ni ikindi cyerekezo gikura.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
  • Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
  • Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Witondere

  • Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
  • Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
  • Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Intambwe ikurikira

  1. Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
  2. Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
  3. Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
  4. Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Weight Initialization quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Gutangiza ibiro ni iki?

Nigute washyiraho imiyoboro itangirira uburemere mbere yo gutangira imyitozo, ishushanya cyane niba ibimenyetso na gradients bigumana ubuzima bwiza binyuze mubice byimbitse. Gutangiza neza ni itandukaniro riri hagati yo guhuza byihuse nicyitegererezo kitigera cyiga.

Kuki gutangiza ibipimo byose kuri zeru ari ikosa ryica?

Hamwe nuburemere bumwe, buri neuron ibara ibisohoka hamwe na gradient imwe, kuburyo bavugurura kimwe kandi urwego ntirushobora kwiga ibintu bitandukanye.

We (Kaiming) itangizwa ryagenewe byumwihariko ibikorwa byo gukora?

Yatangije umunzani utandukanya na 2 / fan_in kugirango yishyure ReLU zeru hafi kimwe cya kabiri cyinjiza.

Niyihe ntego nyamukuru ya gahunda yo gutangiza ibiro?

Imigambi nka Xavier na Yahisemo itandukaniro ryuburemere kuva mubunini kuburyo ibimenyetso bitazimangana cyangwa ngo biturike nkuko bikwirakwiza.

Gutangiza Xavier (Glorot) bikwiranye neza nurusobe ukoresheje ibikorwa?

Xavier iringaniza imbere ninyuma itandukanye kubikorwa, guhuza ibikorwa nka tanh na sigmoid.

Kuki Itangiriro ikoresha itandukaniro rya 2 / umufana_in aho gukoresha 1 / umufana_in?

ReLU inyuramo gusa inyongeramusaruro nziza, ikajugunya hafi kimwe cya kabiri cyibimenyetso, bityo gukuba kabiri ibitandukanya bigarura ibyateganijwe gukora.