Tsare Tsare-tsare da Faduwa
Tsare-tsare yana kawar da gabaɗayan abubuwan hanyar sadarwa na jijiyoyi, kamar kawunan hankali, neurons, ko gabaɗayan yadudduka, don haka ƙirar slimmer tana aiki da sauri akan kayan aikin yau da kullun.
Dubawa
Fadin Layer shine mafi girman sigar tada hankali, yana share cikakkun tubalan masu canza canji zuwa zurfin zurfi.
Zurfafa nutsewa
Yanke da ba a tsara ba yana fitar da ma'aunin mutum ɗaya, amma matrix mai cike da sifili tarwatse har yanzu yana gudana cikin cikakken gudu akan GPUs saboda kayan aikin baya tsallake su. Tsare-tsare da aka tsara a maimakon haka yana kawar da tubalan daidaitawa, gabaɗayan kawunan hankali, na'urorin gaba-gaba, tashoshi, ko yadudduka gabaɗaya, waɗanda a zahiri suna raguwa da tenors kuma suna haifar da saurin gudu ba tare da ƙwaya ta musamman ba. Faɗin Layer yana matsar da wannan mafi nisa: bincike kamar LayerDrop da kuma daga baya aikin zurfafawa ya nuna cewa yawancin yadudduka na transfoma, musamman a cikin tari na tsakiya da na sama, suna da ban mamaki. Kuna iya sau da yawa share kashi 20 zuwa 40 na yadudduka kuma ku dawo da mafi yawan daidaiton da aka rasa tare da ɗan gajeren zagaye na daidaitawa ko rarrabuwar ilimi. Ana yin la'akari da mahimmanci ta hanyar awo kamar nisa na kusurwa tsakanin shigarwar Layer da fitarwa (nawa yake canza wakilci).
Fahimtar Fasaha
Tsarin girke-girke na gama-gari yana ƙididdige kowane toshe ta yadda shigarsa da fitar da ɓoyayyun jihohi suke: idan Layer ya canza rafukan da ya rage (ƙaman kamannin cosine), yana ba da gudummawa kaɗan kuma ana iya sauke shi. Ana iya sanya kawunan su ta hanyar hankali, haɓakar asara lokacin da aka rufe su. Bayan cire mafi ƙasƙanci-maki raka'a, wani taƙaitaccen mataki na distillation zai bar ma'aunan da suka tsira su sake sha aikin ɓangarorin da aka datse kuma su dawo da inganci.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Tsare Tsare-Tsare da Zubewar Layer
Tsare-tsare da zurfin datsa suna zama ma'auni don samar da ingantattun bambance-bambancen samfuri daga babbar hanyar sadarwar da aka riga aka horar, kamar yadda ake gani a cikin nisa-da-zurfin pruning tare da distillation bututun da ke samun ƙananan ƙira daga manyan. Yi tsammanin haɗin kai mai ƙarfi tare da ƙididdigewa da kewayawa, dasa kayan masarufi wanda ke nufin takamaiman masu haɓakawa, da bincike mai sarrafa kansa wanda ke yanke shawarar kowane zurfin turawa nawa zurfin ko faɗin da za a yanke don kasafin latency da aka bayar.
Aiwatar da Gaskiyar Duniya
Distilling ƙaramin, samfurin ɗalibi mai sauri daga babban malami ta hanyar yankan yadudduka sannan daidaitawa don dawo da daidaito
Cire manyan kantunan hankali a cikin tsarin fassarar don yanke jinkiri akan na'urorin gefen
Zubar da manyan tubalan LLM don cimma maƙasudin latency na wayar hannu
Ƙirƙirar iyali masu girman samfuri daga wurin bincike da aka riga aka horar ta hanyar datsa zuwa zurfin da faɗi daban-daban
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Structured Pruning and Layer Dropping quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Samfurin Yankewa
Tambayoyin da ake yawan yi
Menene Tsare Tsare-Tsare da Faduwa?
Tsare-tsare yana kawar da gabaɗayan abubuwan hanyar sadarwa na jijiyoyi, kamar kawunan hankali, neurons, ko gabaɗayan yadudduka, don haka ƙirar slimmer tana aiki da sauri akan kayan aikin yau da kullun. Faduwa Layer shine mafi girman siga mai tsauri, yana share cikakkun tubalan na'ura don rage zurfin.
Me yasa tsatsawar da aka tsara ta haifar da saurin gudu yayin da ba a tsara shi ba sau da yawa?
Cire gaba dayan kawunansu, neurons, ko yadudduka yana rage girman tensor, don haka daidaitaccen kayan aiki mai yawa ba ya aiki kaɗan, yayin da tarwatsewar sifili har yanzu ana ƙididdige su.
Menene 'Layer dropping' a cikin mahallin transfoma?
Faɗin Layer yana kawar da duka tubalan na'ura mai canzawa, yana yanke zurfin hanyar sadarwa, wanda shine mafi girman nau'i na tsatsa da aka tsara.
Wanne sigina yawanci ke nuna cewa za'a iya sauke Layer na transformer lafiya?
Idan Layer da kyar ya canza rafi (babban shigar shigar da kamanni), yana ba da gudummawa kaɗan kuma ɗan takara ne don cirewa.
Wane mataki yawanci ke dawo da daidaito bayan da aka tsara?
Taƙaitaccen daidaitawa ko distillation yana barin sauran ma'aunin nauyi su sake sha aikin raka'o'in da aka yanka kuma su dawo da mafi yawan ingancin da suka ɓace.
Yaya sau da yawa ake ba da fifikon kawunan kai don dasa?
Ana ƙididdige mahimmancin kai da yawan asarar da aka yi idan an rufe shi; Ana datse kawunan marasa hankali da farko.