AMABWIRIZA Yibanze

Imikorere

Imikorere yo gukora ni amarembo mato adafite umurongo imbere muri buri neuron ireka imiyoboro yimitsi yiga ibintu bigoye, bigoramye aho kuba imirongo igororotse gusa.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Igihe kizaza cyo gukora
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Bitabaye ibyo, umuyoboro wimbitse wasenyuka muburyo bumwe.

Kwibira cyane

Buri neuron ibara umubare uremereye winjiza, ariko ayo mafaranga yonyine ni umurongo. Shyira kumurongo umwe kumurongo kandi, mubiharuro, uracyafite gusa umurongo umwe munini wumurongo, nubwo byimbitse. Imikorere yibikorwa isenya ibi ukoresheje impinduka zidafite umurongo kuri buri neuron isohoka, biha imiyoboro imbaraga zo kugereranya ibikorwa hafi ya byose. Icyamamare cyane ni ReLU, isohora gusa ibyinjijwe niba ari byiza na zeru ukundi; birihuta kandi birinda ibibazo bimwe byamahugurwa yimikorere ishaje. Sigmoid na tanh squash indangagaciro zingana kandi byari bisanzwe mumateka ariko birashobora kubabazwa na gradients zishira mumurongo wimbitse. Imikorere ya softmax, ikoreshwa kubisohoka, ihindura amanota mbisi muburyo bwo gukwirakwiza amasomo.

Gushyira mu bikorwa Isi

Gukoresha ReLU muburyo bwihishe bwurusobekerane rwihishwa kugirango rushobore kwiga imipaka ifatirwa ibyemezo kugirango tumenye amashusho

Koresha softmax kumurongo wanyuma kugirango uhindure urutonde rwibanze rwamanota mubyiciro byashoboka byose hamwe

Guhitamo ibikorwa bya GELU imbere yimiterere yururimi rwimikorere ya gradient igenda neza

Guhindukira kuri Leaky ReLU mugihe neuron nyinshi murusobe zapfuye zikareka kwitabira

Igihe kizaza cyo gukora

ReLU na mubyara wacyo mwiza GELU yiganje uyumunsi, hamwe na GELU itoneshwa na transformateur kuko umurongo ucuramye uhuza neza hamwe namahugurwa yabo. Ubushakashatsi bugaragaza ibikorwa byize kandi byakinguwe nka SwiGLU, ubu bikunze kugaragara mururimi runini rwururimi, rukoresha amarembo menshi kugirango yongere ibitekerezo. Inzira yagutse ireba imikorere yoroshye, yuguruye imikorere itezimbere gahoro gahoro nubwiza bwikitegererezo. Mugihe ibikorwa bidasanzwe bigaragara buri gihe mubipapuro, byoroshye, imyitwarire yitwaye neza ikunda gutsinda mubikorwa kuko bitoza kwizerwa muburyo bukomeye.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Ibyemezo bisobanutse. Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
  • Igiciro na bije. Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
  • Itsinda hamwe nakazi. Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.

Witondere

  • Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
  • Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
  • Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.

Intambwe ikurikira

  1. Tangira nururimi rusobanutse rwibisubizo ukeneye.
  2. Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
  3. Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
  4. Inyandiko aho Imikorere yo Gufasha ifasha nuburyo bworoshye bworoshye.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Fata ikibazo cyo Gukora

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Imikorere yo Gukora Niki?

Imikorere yo gukora ni amarembo mato adafite umurongo imbere muri buri neuron ireka imiyoboro yimitsi yiga ibintu bigoye, bigoramye aho kuba imirongo igororotse gusa. Bitabaye ibyo, umuyoboro wimbitse wasenyuka muburyo bumwe.

Ni ukubera iki gutondekanya umurongo gusa bidashobora kwiga imipaka igoramye?

Hatariho ibikorwa bidafite umurongo, imirongo myinshi igizwe numurongo ugereranya.

Kuberiki sigmoid na tanh biga kwigira mumurongo wimbitse mugihe inyongeramusaruro igeze kurenza urugero?

Mugihe gikabije, gradients zabo hafi-zeru zigabanya ibimenyetso byinyuma.

Multiclass classifier ikenera ibisohoka indangagaciro zingana nimwe murwego rwamasomo. Ni uwuhe murimo umuyobozi ukoresha?

Softmax ihindura amanota y'ibyiciro muburyo bwo gukwirakwiza amasomo.

Ikibazo "gupfa ReLU" gisobanura iki mubuyobozi?

ReLU yagumye yakira inyongeramusaruro mbi irashobora gukomeza gusohora zeru, ikabuza ivugurura ryingirakamaro binyuze muri kiriya gice.

Ni ubuhe buryo butandukanye busabwa mugihe ibice byinshi bya ReLU bikomeje kudakora?

Ubuyobozi bwita Leaky ReLU nkigisubizo cyibice byapfuye kuko uruhande rwarwo rutameze neza kuri zeru.