Jadawalin Yawan Koyo
Jadawalin ƙimar koyo yana canza girman mataki yayin horo maimakon riƙe shi a tsaye.
Dubawa
Getting it right is often the single biggest lever for whether a model converges quickly and reaches high accuracy.
Zurfafa nutsewa
Adadin koyo yana sarrafa yadda babban mataki mai ingantawa ke ɗaukar kowane sabuntawa. Maɗaukaki da haɓaka horo; yayi kasa sosai kuma yana rarrafe ko ya makale. Jadawalin yana daidaita wannan ƙimar akan lokaci. Girke-girke na yau da kullun na yau da kullun yana biye da lalacewa: fara kusa da sifili kuma ku tashi sama da matakai na ɗari ko dubunnan na farko (don haka da wuri, gradients masu surutu ba sa busa ma'aunin nauyi), sannan a hankali raguwa. Shahararrun sifofi masu lalacewa sun haɗa da ruɓar mataki (saukar da sifili a zamanin da aka saita), lalatar fa'ida, da raɗaɗin cosine, wanda a hankali yana bin lanƙwasa rabin cosine zuwa kusa da sifili. Jadawalin Cosine tare da dumin layi na layi yanzu sun zama daidaitattun don horar da manyan nau'ikan harshe, yayin da tsarin zagayowar lokaci da tsarin zagayowar guda ɗaya na iya haɓaka ƙaramin horo na samfuri.
Fahimtar Fasaha
Abubuwan da ke da zafi saboda masu inganta haɓakawa kamar Adam suna da ƙididdige ƙididdiga na lokaci na biyu a cikin matakan farko; ƙaramin koyo yana guje wa lalata ma'aunin nauyi kafin waɗannan ƙididdigan su daidaita. Cosine annealing ya saita lr = lr_min + 0.5 * (lr_max - lr_min) * (1 + cos(pi * t / T)), yana ba da ci gaba cikin sauri da wuri da kankanin, matakan daidaitawa kusa da ƙarshe. Wasu jadawali suna ƙara sake kunnawa mai dumi, suna tsallen ƙimar baya sama don tserewa ƙarami mai kaifi.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Jadawalin Yawan Koyo
Yayin da horo ke gudana yana da tsada, ana tsara tsarin jadawalin tare da masu ingantawa da girman batch, kuma masu bincike suna nazarin dokokin ƙididdiga don tsinkaya mafi kyawun ƙimar ƙimar kafin horo. Abubuwan ingantawa marasa tsarin tsarawa waɗanda ke cire buƙatar ɗaukar lalurar ɓarna a gaba suna samun karɓuwa, kuma daidaitawa, jaddawalin ra'ayoyin da ke ba da amsa ga masu lanƙwasa asara na iya rage gwaji-da-kuskure wanda har yanzu ya mamaye babban horo.
Aiwatar da Gaskiyar Duniya
Dumi-dumin layi tare da lalata cosine da ake amfani da su lokacin da ake horar da ƙirar yaren canji.
Rushewar mataki wanda ke sauke ƙimar koyo 10x a zamanin 30, 60, da 90 lokacin horar da masu rarraba hoto akan ImageNet.
Manufar sake zagayowar sau ɗaya a cikin fast.ai don horar da abin ƙira zuwa daidaito mai kyau a cikin ƴan lokuta kaɗan.
Cosine annealing tare da dumi sake kunnawa don guje wa ƙarancin asara mai kaifi lokaci-lokaci da haɓaka haɓakawa.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Learning Rate Scheduling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Yawan Koyon Zagaye
Tambayoyin da ake yawan yi
What is Learning Rate Scheduling?
Jadawalin ƙimar koyo yana canza girman mataki yayin horo maimakon riƙe shi a tsaye. Samun daidai sau da yawa shine babban lefa guda ɗaya don ko samfurin yana haɗuwa da sauri kuma ya kai daidaitattun daidaito.
Menene manufar lokacin 'dumi' a cikin jadawalin ƙimar koyo?
Warmup yana farawa kusa da sifili kuma yana ƙara ƙimar ta yadda sabbin abubuwan sabuntawa na farko kar su lalata ƙirar kafin kididdigar ingantawa ta daidaita.
Wanne jadawali yana bin tsarin rabin cosine a hankali zuwa mafi ƙarancin ƙima?
Cosine annealing yana lalata ƙimar koyo tare da siffar rabin cosine, yana ba da manyan matakai da wuri da ƙananan matakai kusa da ƙarshe.
Me zai faru idan an saita ƙimar koyo da yawa sosai?
Matsakaicin adadin da ya wuce kima yana haifar da wuce gona da iri, don haka asarar na iya yin billa ko busawa maimakon daidaitawa.
Menene lalacewar mataki ke yi ga ƙimar koyo?
Ruɓawar mataki yana ninka ƙimar da ma'auni (misali, 0.1) a zaɓaɓɓun matakan da aka zaɓa, ƙirƙirar ƙirar matakala.
Me yasa ake ƙara 'sake farawa da dumi' wani lokaci zuwa jadawalin?
Sake farawa mai dumi yana tsalle ƙimar koyo sama a tazara, yana taimaka wa mai haɓakawa ya fita daga ƙunƙuntaccen mafi ƙaranci da gano ingantattun mafita.