Zazzabi da Samfura
Zazzabi da samfuri su ne lambobin bugun kira waɗanda ke sarrafa yadda 'bazuwar' ko 'lafiya' kalmomin ƙirar harshe suke.
Dubawa
They decide whether you get the same predictable answer every time or fresh, varied phrasing.
Zurfafa nutsewa
A kowane mataki, samfurin harshe ba ya fitar da kalma kai tsaye - yana samar da maki ('logit') ga kowane alama a cikin ƙamus ɗinsa, wanda softmax ya juya zuwa rarraba yiwuwar. Samfura shine yadda ake zaɓar alamar gaba daga wannan rarraba. Zazzabi yana sake fasalin rarrabawa kafin zabar: ƙananan zafin jiki yana sa babban zaɓi ya mamaye, don haka fitarwa yana mayar da hankali da maimaitawa; babban zafin jiki yana daidaita shi, yana barin alamun da ba za a iya yiwuwa su shiga don ƙarin iri-iri (da ƙarin kurakurai). Shahararrun tacewa guda biyu sun fara kunkuntar tafkin da farko. Top-k yana adana alamun yuwuwar k kawai. Top-p, ko samfurin tsakiya, yana riƙe mafi ƙarancin saiti na alamomi waɗanda yiwuwarsu ta haura zuwa p (ce 0.9), don haka tafkin yana girma lokacin da samfurin ba shi da tabbas kuma yana raguwa lokacin da yake da tabbaci. Tare waɗannan saitunan suna musayar aminci da kerawa.
Fahimtar Fasaha
Zazzabi yana aiki ta hanyar rarraba kowane logit ta T kafin softmax: yuwuwar ta yi daidai da exp(logit / T). T da ke ƙasa 1 yana haɓaka giɓi don haka alamar saman ta mamaye; T sama da 1 yana raguwa da raguwa kuma yana daidaita rarraba. A T kusa da 0 samfurin ya zama mai haɗama sosai, koyaushe yana ɗaukar alamar da ta fi dacewa. Top-k yana ƙididdige ɗan takarar a ƙayyadadden lamba, yayin da top-p yana saita yanke yiwuwar yiwuwar tarawa, don haka ƙidayar ɗan takarar ta ya dace da yadda ƙirar ke a wannan matakin.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Zazzabi da Samfura
Waɗannan abubuwan sarrafawa suna da tsayi kuma an fahimce su sosai, don haka aikin yana cikin mafi wayo da kuma sabbin bambance-bambancen. Yi tsammanin ƙarin tsare-tsare masu daidaitawa kamar min-p (wanda ke daidaita yankewa zuwa yuwuwar alamar alama) da zafin jiki mai ƙarfi wanda ke canza tsakiyar tsara. Kayan aiki zai ƙara ɗaukar saitunan atomatik kowane ɗawainiya - ƙananan don lamba da cirewa, mafi girma don ƙwaƙwalwar ƙwaƙwalwa - don haka masu amfani ba za su kunna da hannu ba. Babban ra'ayin yana dawwama: samfuri shine mai sauƙi, ƙulli mai ƙarfi tsakanin ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙirƙira da iri-iri.
Aiwatar da Gaskiyar Duniya
Saita zafin jiki kusa da 0 don ƙirƙira lamba ko hakar bayanai, inda kuke son amsa daidai ɗaya kowane lokaci
Haɓaka zafin jiki zuwa kusan 0.8-1.0 don ƙaddamar da sunaye, taken, ko ra'ayoyin labari don samun zaɓuɓɓuka daban-daban
Yin amfani da top-p a kusa da 0.9 don haka samfurin samfuran daga mafi kyawun kalmomi kawai kuma yana guje wa alamu masu ban mamaki.
Aiwatar da top-k ga ƴan takara da kuma hana ƙarancin jigogi, kalmomin da ba sa magana ba su bayyana a cikin amsawar abokin ciniki.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Temperature and Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Nucleus da Top-k Samfurin
Tambayoyin da ake yawan yi
What is Temperature and Sampling?
Zazzabi da samfuri su ne lambobin bugun kira waɗanda ke sarrafa yadda 'bazuwar' ko 'lafiya' kalmomin ƙirar harshe suke. Suna yanke shawara ko kuna samun amsa iri ɗaya da ake iya faɗi kowane lokaci ko sabo, jimla daban-daban.
Menene haɓaka zafin jiki ke yi ga fitowar samfur?
Mafi girman zafin jiki yana daidaita rarraba yuwuwar, don haka ana samun alamun da ba su da yuwuwa sau da yawa, suna samar da ƙarin nau'ikan fitarwa (da haɗari).
Yaya samfurin top-p (nucleus) ya bambanta da samfurin top-k?
Top-p yana daidaita ɗan takarar da aka saita ta yuwuwar tarawa, yayin da top-k koyaushe yana riƙe ƙayyadadden adadin manyan alamu.
Mechanical mechanical, menene a zahiri zafin jiki ke yi ga logits?
Zazzabi yana raba kowane logit ta T kafin softmax; T da ke ƙasa 1 yana haɓaka rarrabawa, T sama da 1 yana daidaita shi.
Don samar da lamba ko ciro bayanan da aka tsara, wanne saiti ya fi kyau?
Ayyukan da ke buƙatar daidaito da maimaitawa suna amfani da ƙananan zafin jiki don haka ƙirar ta dogara da zaɓin mafi kusantar, daidaitattun alamu.
Me ke faruwa a yanayin zafi mai inganci na 0?
Kusa da zafin jiki na sifili, rarraba yana da kaifi sosai cewa ana zabar alamar yiwuwar mafi girma koyaushe - ƙididdige ƙima.