Tsara Samfura da Bayyana Bias
Ƙaunar bayyanawa ita ce tazar da ke bayyana lokacin da samfurin da aka horar da shi a kan cikakkiyar maƙasudi kawai dole ne, bisa ga ra'ayi, yanayi a kan abubuwan da ba su da kyau.
Dubawa
Samfurin da aka tsara shine tsarin karatun da ke rufe wannan rata a hankali.
Zurfafa nutsewa
Samfuran da aka horar da malaman tilastawa kawai suna ganin alamun gaskiya a matsayin mahallin, amma a lokacin tsarawa suna mayar da nasu hasashen. Lokacin da kuskuren farko ya faɗi samfurin a cikin yanayin da bai taɓa haɗuwa da shi ba yayin horo, kurakurai na iya yin dusar ƙanƙara, yanayin gazawar da ake kira nuna son kai. Samfuran da aka tsara, wanda Bengio da abokan aiki suka gabatar a cikin 2015, yana magance wannan ta hanyar jujjuya tsabar kudi a kowane mataki na yanke hukunci yayin horo: tare da wasu yuwuwar yana ciyar da alamar gaskiya (tilasta malami) kuma in ba haka ba yana ciyar da hasashen samfurin samfurin kansa. Yiwuwar yin amfani da gaskiya ta ƙasa tana farawa kusa da ɗaya kuma ta lalace akan horo ta hanyar jadawali (mai layi, ma'auni, ko inverse-sigmoid), don haka samfurin yana ci gaba da fallasa abubuwan da aka fitar kuma ya koyi farfadowa daga kura-kuransa.
Fahimtar Fasaha
A mataki t samfurin yana yin samfurin Bernoulli m tare da yuwuwar epsilon_i na zabar alamar zinare; epsilon_i yana lalacewa yayin da ake ci gaba da horo. Da dabara shine ciyar da samfuran samfuri yana sa manufar ta kasance mai son zuciya kuma samfurin ƙima ba zai bambanta ba, don haka gradients ba sa gudana cikin tsafta ta alamar ciyarwa. Bambance-bambancen suna amfani da madaidaiciya-ta Gumbel-softmax ko bambance-bambancen shakatawa don rage wannan, kuma hanyoyin matakan-jeri suna haɓaka ma'auni kamar BLEU kai tsaye.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Tsara Samfurori da Bayyana Son Zuciya
Ga manyan samfuran harshe na Transformer ana muhawara akan tasirin tasiri na nuna son kai, tunda manyan bayanai da ma'auni suna lalata shi, da kuma hanyoyin kamar RLHF suna sake fasalin ɗabi'ar tsara kai tsaye. Har yanzu, samfurin da aka tsara da zuriyarsa sun kasance masu dacewa ga ƙananan ƙira, tsararrun tsarawa, da ɗawainiya tare da ingantattun buƙatu. Aiki na gaba yana haɗu da bayyanar da manhaja, tsarin tsarin ƙarfafawa, da horon ƙaƙƙarfan haɗari don daidaita yadda ake horar da ƙira da yadda a zahiri suke yanke lamba.
Aiwatar da Gaskiyar Duniya
Horar da samfurin ɗaukar hoto tare da tsara samfurin don ya koyi ci gaba da alheri bayan kalma mara kyau da aka annabta.
Lalacewar yuwuwar tilasta malami tare da juzu'i-sigmoid a cikin tsarin fassarar injin jijiya.
Gano abin chatbot wanda ke shiga cikin madaukai marasa daidaituwa azaman alamar nuna son kai daga tilastawa malami mai tsafta.
Kwatanta yawan BLEU na taƙaitaccen bayani wanda aka horar tare da cikakken malami mai tilastawa tare da wanda aka horar tare da tsara samfurin.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Scheduled Sampling and Exposure Bias quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Samfuran Mara Kyau da Ƙimar Ƙimar Haɓaka Amo
Tambayoyin da ake yawan yi
Menene Tsarin Samfurin da Nuna Bambanci?
Ƙaunar bayyanawa ita ce tazar da ke bayyana lokacin da samfurin da aka horar da shi a kan cikakkiyar maƙasudi kawai dole ne, bisa ga ra'ayi, yanayi a kan abubuwan da ba su da kyau. Samfuran da aka tsara tsari ne wanda ke rufe wannan gibin a hankali.
Menene tsarin samfurin da aka tsara ke yi yayin horo?
Shirye-shiryen samfurin da aka tsara yana gauraya gaskiya-gaskiya da alamun da aka samar da samfur azaman abubuwan shigar da dikodi, wanda yuwuwar lalacewa ke sarrafawa.
Ta yaya yuwuwar yin amfani da alamar gaskiya ta ƙasa ta canza akan horon da aka tsara?
Jadawalin yana farawa kusa da cikakken malamin tilastawa da lalata don haka samfurin yana ƙara fallasa ga tsinkayar kansa yayin da yake inganta.
Wanene ya gabatar da samfurin da aka tsara, kuma a yaushe ne?
Samy Bengio da abokan aiki ne suka gabatar da samfurin da aka tsara a cikin 2015 don tsinkaya jeri tare da cibiyoyin sadarwa masu maimaitawa.
Wane tsari na jadawalin aka fi ambata don lalata yuwuwar tilastawa malami?
Asalin aikin ya ba da shawarar jeri jeri na lalata na layi-layi, mai juzu'i, da juzu'i-sigmoid don rage yuwuwar samfurin gaskiya na ƙasa.