Itsinda risanzwe
Itsinda risanzwe ni tekinike ituma imyitozo ya nete ihuza imyitozo muburyo busanzwe mumatsinda mato yimiyoboro, yigenga kuri buri rugero.
Incamake
It matters because, unlike Batch Normalization, it works well even when batches are tiny.
Kwibira cyane
Ibisanzwe bisanzwe bituma imibare itembera mumurongo uringaniye neza, wihuta kandi ugahugura imyitozo. Batch Normalisation ibikora mukubara ibisobanuro nibitandukaniro bya buri kintu murwego rwa mini-batch yose, ariko ibyo bituma byoroha mugihe ibyiciro ari bito, kubera ko imibare iba urusaku kandi itizewe. Itsinda risanzwe, ryatangijwe na Wu na He muri 2018, rikuraho icyiciro muburinganire burundu. Kuri buri rugero rwumuntu ku giti cye, rugabanya imiyoboro mumibare ihamye yitsinda, hanyuma risanzwe buri tsinda ukoresheje urwo rugero rwonyine. Kuberako kubara bitigera biterwa nizindi ngero mugice, imikorere igumaho neza niba itsinda rifite amashusho 32 cyangwa rimwe gusa, bigatuma rikundwa mugushakisha, gutandukanya, no kwibuka-uburemere bwibikorwa.
Ubushishozi
Itsinda risanzwe risobanura ibisobanuro no gutandukana kurwego rwibibanza no hejuru yimiyoboro muri buri tsinda, kuri sample. Hanyuma birasanzwe kuri zeru bisobanura hamwe nibice bitandukanye kandi bigakoreshwa byize kuri buri muyoboro (gamma) na shift (beta). Ihuza izindi gahunda: hamwe nitsinda rimwe rihinduka Ubusanzwe, kandi hamwe numuyoboro umwe kuri buri tsinda bihinduka Instance Normalisation. Amatsinda yo kubara ni hyperparameter, akenshi ashyirwa kuri 32.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza h'itsinda risanzwe
Itsinda risanzwe rigumaho guhitamo ahantu hose ibyiciro bigomba kuba bito, nkibisubizo bihanitse byo gutahura no gutandukanya, moderi ya 3D na videwo, hamwe namahugurwa adafite kwibuka. Yinjijwe kandi mubwubatsi bukoreshwa cyane nka U-Nets imbere ya moderi yo gukwirakwiza. Mugihe icyitegererezo gikura kandi igitutu cyo kwibuka kigasunika ingano yubunini, icyiciro-cyigenga gisanzwe, Itsinda Norm muri bo hamwe na Layeri Norm, birashoboka ko byakomeza kuba inyubako zubatswe, hamwe nubushakashatsi bukomeje kubivanga hamwe nubundi buryo butari busanzwe.
Gushyira mu bikorwa Isi
Gutahura ibintu hamwe nurugero rwicyiciro (urugero, Mask R-CNN yerekana imiterere) yatojwe hamwe na bike cyane kuri GPU.
U-Net umugongo imbere mugukwirakwiza amashusho, aho Itsinda Norm rihindura umunzani.
Imiyoboro ya 3D na videwo aho kwibuka cyane gukoresha imbaraga zingana kugeza kuri imwe cyangwa ebyiri.
Kuringaniza neza icyerekezo kinini cyicyitegererezo kubikoresho bigarukira aho uduce duto dutuma imibare ya Batch Norm itizewe.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Itsinda risanzwe rifasha kandi uburyo bworoshye ni bwiza.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Group Normalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Itsinda ryibihembo bisanzwe muri RLHF
Ibibazo bikunze kubazwa
What is Group Normalization?
Itsinda risanzwe ni tekinike ituma imyitozo ya nete ihuza imyitozo muburyo busanzwe mumatsinda mato yimiyoboro, yigenga kuri buri rugero. Nibyiza kuko, bitandukanye na Batch Normalisation, ikora neza nubwo ibyiciro ari bito.
Ni izihe nyungu nyamukuru zo Guhindura Amatsinda Kurwego Rwisanzwe?
Kuberako Itsinda Norm ribara imibare kurugero kuruta kuruhande, ntabwo ryateshejwe agaciro nuduce duto, bitandukanye na Batch Norm.
Niki hejuru yitsinda risanzwe risobanura icyo risobanura kandi ritandukanye?
Igabanya imiyoboro mumatsinda kandi isanzwe buri tsinda ukoresheje urwo rugero rumwe gusa indangagaciro hamwe n’ahantu hatandukanye, wirengagije ibisigaye.
Itsinda risanzwe rihinduka urwego rusanzwe mubihe bidasanzwe?
Hamwe nitsinda rimwe, imiyoboro yose isanzwe hamwe kurugero, aribwo buryo busanzwe.
Itsinda risanzwe rihinduka Ingero zisanzwe mubihe bidasanzwe?
Niba buri tsinda rifite umuyoboro umwe, buri muyoboro usanzwe kurugero rwarwo, aribwo buryo busanzwe.
Nyuma yo gukora ibisanzwe, Itsinda Norm risaba iki kugirango ugarure ibintu byoroshye?
Kimwe nizindi nzego zisanzwe, Itsinda Norm ririmo igipimo cyiga nigipimo cyo guhindura kugirango urusobe rushobore gusubiramo cyangwa guhindura ibisanzwe nkuko bikenewe.