Ibisanzwe
Ubusanzwe ibisanzwe ni tekinike ikuraho inyongeramusaruro kuri buri cyiciro cyurusobe rwimitsi mugihe cyamahugurwa, bigatuma imiyoboro yimbitse itoza byihuse kandi byizewe.
Incamake
It became one of the most widely used tricks in deep learning.
Kwibira cyane
Nkuko amakuru atembera mumurongo wimbitse, ikwirakwizwa ryindangagaciro zigaburira buri cyiciro gikomeza guhinduka nkuko ibice byabanje bivugururwa, bikadindiza kandi bigahagarika amahugurwa. Ibisanzwe bisanzwe, byatangijwe na Ioffe na Szegedy mumwaka wa 2015, bikemura iki kibazo muguhindura buri cyiciro cyinjiza muri mini-batike iriho kuburyo bafite zero zeru hamwe nibice bitandukanye. Ihita ikoresha ibipimo bibiri byiga, gamma na beta, reka urwego rwurusobe kandi ruhindure indangagaciro zisanzwe inyuma niba ibyo bifasha, bityo ntutakaze imbaraga zo guhagararira. Kwishura ni binini: imiyoboro yihanganira igipimo cyo hejuru cyo kwiga, guhurira mugihe gito, ntabwo yunvikana no gutangira ibiro, kandi akenshi iba rusange muri rusange. Gufata ni uko imyitwarire ishingiye ku mibare y'ibyiciro, bityo uduce duto cyane dushobora gutuma idahungabana.
Ubushishozi
Kuri buri kintu kiranga mini-batch, icyiciro gisanzwe kibara icyiciro gisobanura kandi gitandukanye, gikuramo uburyo, kandi kigabanywa no gutandukana bisanzwe (hiyongereyeho epsilon ntoya kugirango ituze). Hanyuma isohora gamma inshuro zisanzwe agaciro hiyongereyeho beta, aho gamma na beta biga. Mugihe cy'amahugurwa ikoresha imibare yuzuye mugihe nayo ikomeza kugereranya; mugihe cyo gufata umwanzuro uhinduranya kubitswe biringaniye ugereranije rero guhanura ntibiterwa nizindi ngero zibaho kugirango dusangire icyiciro. Mubisanzwe byinjijwe hagati yumurongo wumurongo wumurongo nigikorwa cyo gukora.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'ibisanzwe
Ubusanzwe ibisanzwe bikomeza kuba akazi muburyo bwo kwerekana icyerekezo, ariko gushingira ku mibare y'ibyiciro ntibisanzwe ku miyoboro isubirwamo, uduce duto, hamwe n'amahugurwa yatanzwe. Ibyo byatumye habaho ubundi buryo nkibisanzwe bisanzwe, bisanzwe mubisanzwe murugero rumwe none biganje muburyo bwo guhindura ibintu, hiyongereyeho itsinda hamwe nurugero rusanzwe kuri domaine yihariye. Ubushakashatsi bukomeje mumiyoboro idafite ubusanzwe ihuza inyungu zayo binyuze muburyo bwo gutangiza neza no gupima. Tegereza ibisanzwe kugirango ukomeze kuba ngombwa, hamwe na variant yihariye yahisemo guhuza ubwubatsi.
Gushyira mu bikorwa Isi
Kwinjiza icyiciro gisanzwe mubice bya ResNet ishusho itondekanya kugirango ishobore kwitoza hamwe nigipimo cyo hejuru cyo kwiga kandi igahurira mugihe gito cyane.
Gutezimbere amahugurwa yumurongo wimbitse woguhuza amashusho yubuvuzi bwahoze butandukanye nta bisanzwe.
Kugabanya ibyiyumvo byo gutangiza ibiro muburyo bwa CNN, bityo injeniyeri bamara igihe gito-bahuza intangiriro indangagaciro.
Guhindura mumahugurwa-yuburyo bwa batch statistique kububiko bwabitswe mugihe cyohereje icyitegererezo kugirango ibishusho-shusho imwe bigume bihamye.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Batch Normalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
RMSNorm na Pre-Layeri bisanzwe
Ibibazo bikunze kubazwa
What is Batch Normalization?
Ubusanzwe ibisanzwe ni tekinike ikuraho inyongeramusaruro kuri buri cyiciro cyurusobe rwimitsi mugihe cyamahugurwa, bigatuma imiyoboro yimbitse itoza byihuse kandi byizewe. Yabaye imwe mumayeri akoreshwa cyane mukwiga byimbitse.
Ni ubuhe buryo busanzwe busanzwe busanzwe?
Ibipimo ngenderwaho byerekana ibipimo byinjira ukoresheje uburyo hamwe nibitandukanya bibarwa muri mini-batiri iriho, bikomeza ibikorwa muburyo butajegajega nkuko amahugurwa agenda.
Ni ukubera iki icyiciro gisanzwe kirimo ibipimo byiga gamma na beta?
Nyuma yo gukora ibisanzwe kuri zeru nibice bitandukanye, gamma na beta reka urusobe rusubire kandi wongere uhindure indangagaciro niba aribyo bifite akamaro, mubisanzwe rero ntabwo bigabanya ibyo urwego rushobora kugereranya.
Ni izihe nyungu zikunze kuvugwa zifatika zo mubisanzwe?
Mugukomeza ibyinjira byapimwe neza, icyiciro gisanzwe kireka imiyoboro itoza hamwe nigipimo kinini cyo kwiga, guhuza byihuse, kandi ntibitangire gutangira.
Mugihe cyo gufata umwanzuro (guhanura amakuru mashya), ni ubuhe mibare isanzwe isanzwe ikoresha?
Gukoresha imibare nzima yibarurishamibare byatuma habaho guhanura biterwa nizindi ngero zisangira icyiciro. Ahubwo, icyiciro gisanzwe gikoresha impuzandengo yimikorere yabitswe mugihe cyamahugurwa.
Ni ukubera iki icyiciro gisanzwe gishobora kwitwara nabi hamwe nubunini buto cyane?
Ibipimo bisanzwe biterwa no kugereranya ibisobanuro no gutandukana kuva murwego. Hamwe ningero nke cyane, ibyo bigereranyo ni urusaku, rushobora guhungabanya amahugurwa.