Jagoran Harshe AI

Nucleus da Top-k Samfurin

Nucleus (top-p) da samfurin top-k sune hanyoyin zazzagewa waɗanda ke ƙara bazuwar sarrafawa zuwa tsara rubutu ta iyakance waɗanne alamu za a iya zaɓa.

2 min karatuAn sabunta ta ƙarshe

Dubawa

They matter because they make AI writing feel natural and varied instead of repetitive or robotic.

Zurfafa nutsewa

Samfurin harshe yana fitar da rabe-raben yuwuwar rarraba kan dukan ƙamus ɗinsa a kowane mataki. Samfurin kai tsaye daga gare ta na iya ɗaukar alamu mara kyau, ƙananan yuwuwar; ko da yaushe shan babban alama (m) yana haifar da maras ban sha'awa, maimaita madaukai. Samfuran Top-k yana gyara wannan ta hanyar adana alamun yiwuwar mafi girman k kawai (ce k=40), gyarawa, da samfuri a tsakanin su. Samfurin Nucleus, wanda Holtzman et al ya gabatar. a cikin 2019, a maimakon haka yana kiyaye mafi ƙarancin saitin alamun waɗanda yuwuwar yuwuwar yuwuwar su ta wuce madaidaicin p (misali, 0.9) - 'nucleus'. Babban fa'idar ita ce wannan saitin yana raguwa lokacin da ƙirar ke da ƙarfin gwiwa kuma tana faɗaɗa lokacin da ba ta da tabbas, tana daidaitawa da ƙarfi. Dukansu galibi ana haɗa su tare da ma'aunin zafin jiki wanda ke kaifi ko daidaita rarraba kafin yin samfur.

Fahimtar Fasaha

Bambanci mai mahimmanci shine kayyade tare da yanke daidaitawa. Top-k koyaushe yana riƙe daidai alamun k, wanda zai iya zama kaɗan lokacin da zaɓuɓɓuka da yawa sun dace, ko haɗa da takarce lokacin da ma'aurata kawai suke da hankali. Top-p yana adana lamba mai canzawa - kawai isassun alamu don rufe yawan yuwuwar p - don haka yana yanke wutsiya mai tsayin da ba za a iya dogaro da ita ba yayin da take mutunta yadda kololuwa ko lebur take. Zazzabi (yawanci 0.7-1.0) yana daidaita ma'auni kafin kowace hanya: ƙananan dabi'u suna mayar da hankali kan yuwuwar, ƙima mafi girma suna yada shi.

Dabarun Tasiri

Gudu da sikelin

Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.

Shiga ku isa

Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.

Shawarwari masu haske

Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.

Makomar Nucleus da Samfuran Top-k

Ƙididdigar tushen samfurin yanzu shine tsoho don chatbots da kayan aikin ƙirƙira, kuma bincike yana ci gaba da inganta shi: hanyoyin kamar samfuri na yau da kullun, min-p, da eta/epsilon samfur ɗin suna nufin yanke wutsiya da hankali fiye da tsayayyen p ko k. Yi tsammanin zazzage sigogi don zama ƙarin sanin mahallin har ma da koyo, ƙarfafawa ta atomatik don amsoshi na gaskiya da sassauta don ƙaddamar da ƙwaƙwalwa. Kamar yadda samfura ke haɓaka, kulawar samfur a hankali ya kasance mai mahimmanci don daidaita dogaro, bambance-bambance, da rage hasashe.

Aiwatar da Gaskiyar Duniya

Chatbots suna amfani da saman-p kusan 0.9 don ci gaba da ba da amsa daban-daban duk da haka suna daidaita cikin tattaunawa.

Ƙirƙirar mataimakan rubuce-rubuce masu haɓaka zafin jiki da p don ƙaddamar da ra'ayoyin labari iri-iri

Kayan aikin ƙirar ƙira suna rage zafin jiki da k don ƙarin ƙayyadaddun ƙayyadaddun snippets daidai

Masu amfani da API suna daidaita sigogin top_p da top_k don sarrafa yadda abubuwan da samfurin ke da ban sha'awa

Hatsari & Tsare-tsare

Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.

Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.

Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.

Taswirar Hanya

1

Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.

2

Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.

3

Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.

4

Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.

Ci gaba da Bincike

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Nucleus and Top-k Sampling quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Fara tambayoyi

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Tambayoyin da ake yawan yi

What is Nucleus and Top-k Sampling?

Nucleus (top-p) da samfurin top-k sune hanyoyin zazzagewa waɗanda ke ƙara bazuwar sarrafawa zuwa tsara rubutu ta iyakance waɗanne alamu za a iya zaɓa. Suna da mahimmanci saboda suna sa rubuce-rubucen AI su ji na halitta kuma sun bambanta maimakon maimaituwa ko na robotic.

Ta yaya samfurin top-k ke ƙuntata zaɓin alamar?

Top-k yana rarraba rarraba zuwa ƙayyadadden lamba k na mafi yawan alamu masu yiwuwa, sake daidaitawa, da samfurori daga waɗannan.

Menene ma'anar 'nucleus' a cikin samfurin tsakiya (top-p)?

Top-p yana adana mafi ƙanƙanta rukunin manyan alamomi waɗanda yuwuwar yuwuwarsu ta kai p, sannan samfurori a cikinsu.

Menene mabuɗin fa'idar top-p akan top-k?

Dan takarar Top-p yana saita raguwa lokacin da samfurin ya kasance mai ƙarfin gwiwa kuma yana girma lokacin da babu tabbas, sabanin ƙayyadaddun ƙidayar top-k.

Menene ma'aunin zafin jiki ke yi kafin yin samfur?

Ƙananan zafin jiki yana mai da hankali kan yuwuwar akan manyan alamu (mafi ƙaddara); zafin jiki mafi girma yana daidaita shi (mafi bambanta).

Me yasa zamewa tsantsar zari (ko da yaushe babban alamar) sau da yawa ba a so don rubutu mai ƙarewa?

Ƙididdigar zari akai-akai yana makale cikin maimaitawa kuma ya rasa nau'ikan halitta wanda ke samar da samfur.