Daidaita Batch
Daidaita tsari wata dabara ce da ke sake daidaita abubuwan da aka shigar zuwa kowane yanki na hanyar sadarwa na jijiyoyi yayin horo, yana sa hanyoyin sadarwa masu zurfi su horar da sauri da dogaro.
Dubawa
It became one of the most widely used tricks in deep learning.
Zurfafa nutsewa
Yayin da bayanai ke gudana ta hanyar hanyar sadarwa mai zurfi, rarraba dabi'u da ke ciyar da kowane nau'i yana ci gaba da canzawa kamar yadda ake sabunta yadudduka na baya, wanda ke raguwa da kuma lalata horo. Daidaita tsari, wanda Ioffe da Szegedy suka gabatar a cikin 2015, yana magance wannan ta hanyar daidaita abubuwan shigar kowane Layer a cikin ƙaramin tsari na yanzu don haka suna da kusan ma'ana da bambance-bambancen raka'a. Sannan yana amfani da sigogi guda biyu waɗanda za'a iya koyo, gamma da beta, waɗanda ke barin sikelin cibiyar sadarwa kuma su canza dabi'u na yau da kullun idan hakan yana taimakawa, don haka ba zai rasa ikon wakilci ba. Sakamakon yana da girma: cibiyoyin sadarwa suna jure wa ƙimar koyo mafi girma, suna haɗuwa a cikin ƴan zamani, ba su da kula da farawa da nauyi, kuma galibi suna haɓaka ɗan kyau. Abin da ake kamawa shine halayyar ta dogara ne akan kididdigar batch, don haka ƙananan batches na iya sa ta zama rashin kwanciyar hankali.
Fahimtar Fasaha
Ga kowane siffa a cikin ƙaramin tsari, ƙa'idar tsari tana ƙididdige ma'anar batch da bambance-bambancen, yana cire ma'ana, kuma ya rarraba ta daidaitaccen karkata (da ƙaramin epsilon don kwanciyar hankali). Sannan yana fitar da lokutan gamma daidaitattun ƙimar da beta, inda ake koyon gamma da beta. A lokacin horo yana amfani da kididdigar batch na rayuwa yayin da kuma yana kiyaye matsakaicin gudu; a lokacin ƙididdigewa yana canzawa zuwa matsakaicin matsakaicin da aka adana don haka tsinkaya baya dogara da wasu misalan da ke faruwa don raba tsari. Yawancin lokaci ana saka shi tsakanin matakin layin layi na Layer da aikinsa na kunnawa.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Daidaita Batch
Daidaita tsari ya kasance dokin aiki a cikin tsarin hangen nesa na juyi, amma dogaro da kididdigar batch abu ne mai ban sha'awa ga cibiyoyi masu maimaitawa, ƙananan batches, da horarwar da aka rarraba. Wannan ya haifar da ɗaukar wasu hanyoyin kamar daidaitawar Layer, wanda ke daidaita fa'idodin a cikin misali guda ɗaya kuma yanzu ya mamaye gine-ginen gidajen wuta, da rukuni da misali daidaitawa ga takamaiman yanki. Bincike ya ci gaba da kasancewa cikin cibiyoyin sadarwa marasa daidaituwa waɗanda suka dace da fa'idodinsa ta hanyar farawa da ƙima a hankali. Yi tsammanin daidaitawa ya kasance mai mahimmanci, tare da takamaiman bambance-bambancen da aka zaɓa don dacewa da gine-gine.
Aiwatar da Gaskiyar Duniya
Shigar da yadudduka na al'ada a cikin mai rarraba hoto na ResNet don ta iya horarwa tare da ƙimar koyo mafi girma da haɗuwa cikin ƴan zamani kaɗan.
Tabbatar da horar da cibiyar sadarwa mai zurfi ta juyin juya hali don hoton likita wanda a baya ya bambanta ba tare da daidaitawa ba.
Rage hankali ga farawa nauyi a cikin CNN ta al'ada, don haka injiniyoyi suna kashe ɗan lokaci don daidaita dabi'u ta hannu.
Canjawa daga kididdigar tsari na horarwa zuwa madaidaicin madaidaicin gudu lokacin da ake tura samfur don haka tsinkayar hoto ɗaya ta tsaya daidai.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Batch Normalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
RMSNorm da Pre-Layer Normalization
Tambayoyin da ake yawan yi
What is Batch Normalization?
Daidaita tsari wata dabara ce da ke sake daidaita abubuwan da aka shigar zuwa kowane yanki na hanyar sadarwa na jijiyoyi yayin horo, yana sa hanyoyin sadarwa masu zurfi su horar da sauri da dogaro. Ya zama ɗaya daga cikin dabarun da aka fi amfani da su wajen zurfafa ilmantarwa.
Menene daidaita tsarin tsari?
Tsarin tsari yana daidaita abubuwan shigar da Layer ta amfani da ma'ana da bambance-bambancen da aka lissafta a cikin ƙaramin tsari na yanzu, yana kiyaye kunnawa cikin kwanciyar hankali yayin da horo ke ci gaba.
Me yasa daidaita tsarin tsari ya haɗa da sigogin gamma da beta waɗanda za a iya koyo?
Bayan daidaitawa zuwa ma'anar sifili da bambance-bambancen naúrar, gamma da beta sun bar cibiyar sadarwa ta sake daidaitawa da sake canza dabi'u idan hakan yana da fa'ida, don haka daidaitawa baya iyakance abin da Layer zai iya wakilta.
Menene fa'ida mai amfani da aka ambata na daidaita tsari?
Ta hanyar kiyaye abubuwan shigar Layer da sikeli da kyau, ƙa'idar tsari na ba da damar cibiyoyin sadarwa su yi horo tare da ƙimar koyo mafi girma, haɗuwa cikin sauri, kuma su kasance masu kula da farawa.
A lokacin ƙididdigewa (na tsinkaya kan sabbin bayanai), waɗanne kididdiga ne ke amfani da daidaitawa?
Yin amfani da kididdigar kididdigar raye-raye a cikin ƙididdigewa zai sa hasashen ya dogara da waɗanne misalai ne ke raba tsari. Madadin haka, ƙa'idar tsari tana amfani da ƙayyadaddun matsakaiciyar gudu da aka adana yayin horo.
Me yasa daidaitaccen tsari zai iya yin rashin kyau tare da ƙananan ƙananan girma?
Ka'idar tsari ya dogara da kimanta ma'ana da bambanci daga tsari. Tare da ƙananan misalai, waɗannan ƙididdiga suna da hayaniya, wanda zai iya lalata horo.