Nucleus na Top-k Icyitegererezo
Nucleus (top-p) hamwe na top-k icyitegererezo ni uburyo bwa decoding uburyo bwongeramo uburyo bwo kugenzura ibyanditswe muguhagarika ibimenyetso bishobora guhitamo.
Incamake
They matter because they make AI writing feel natural and varied instead of repetitive or robotic.
Kwibira cyane
Ururimi rwicyitegererezo rusohora ikwirakwizwa ryamagambo yose kuri buri ntambwe. Gutoranya biturutse kuri byo birashobora gutoranya ibintu bidasanzwe, ibimenyetso bike-bishoboka; burigihe gufata ikimenyetso cyo hejuru (umururumba) gitanga uduce twinshi, dusubiramo. Top-k icyitegererezo ikosora ibi ukomeza gusa k ibimenyetso byinshi bishoboka (vuga k = 40), guhindura ibintu, no gutoranya muri byo. Nucleus sampling, yatangijwe na Holtzman n'abandi. muri 2019, ahubwo igumisha urutonde ruto rwibimenyetso bifite amahirwe yo guhuriza hamwe kurenza p (urugero, 0.9) - 'nucleus'. Inyungu nyamukuru nuko iyi seti igabanuka mugihe icyitegererezo cyizeye kandi cyaguka mugihe kidashidikanywaho, gihuza imbaraga. Byombi bikunze guhuzwa nubushyuhe bwubushyuhe bukarisha cyangwa buringaniza ikwirakwizwa mbere yo gutoranya.
Ubushishozi
Itandukaniro rikomeye ryakosowe hamwe no guhuza n'imihindagurikire y'ikirere. Hejuru-k buri gihe ibika neza k ibimenyetso, birashobora kuba bike cyane mugihe amahitamo menshi yumvikana, cyangwa ushizemo imyanda mugihe abashakanye gusa bumvikana. Top-p ibika umubare uhinduka - gusa ibimenyetso bihagije kugirango bipfundikire misa p - bityo igabanya umurizo muremure utizewe mugihe wubaha uburyo bwo gukwirakwiza cyangwa hejuru. Ubushyuhe (mubisanzwe 0.7-1.0) bukuraho logi mbere yuburyo ubwo aribwo bwose: indangagaciro zo hasi zibanda kubishoboka, indangagaciro zo hejuru zirayikwirakwiza.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Nucleus na Top-k Gutoranya
Gutoranya gushingira kuri decoding ubu nibisanzwe kuri chatbots nibikoresho byo guhanga, kandi ubushakashatsi bukomeza kubinonosora: uburyo nka sampling isanzwe, min-p, na eta / epsilon icyitegererezo kigamije guca umurizo mubwenge kuruta p cyangwa k ihamye. Tegereza ibipimo bya decoding kugirango urusheho kumenya imiterere-karemano ndetse wige, uhite ushimangira ibisubizo bifatika no kurekura ibitekerezo. Mugihe icyitegererezo kigenda gitera imbere, kugenzura byitondewe bikomeza kuba ingenzi mukuringaniza kwizerwa, gutandukana, no kugabanya salusiyo.
Gushyira mu bikorwa Isi
Ibiganiro ukoresheje top-p hafi 0.9 kugirango ibisubizo bikomeze ariko bihuze mubiganiro
Abafasha kwandika buhanga bazamura ubushyuhe na p kugirango bungurane ibitekerezo kubitekerezo bitandukanye
Ibikoresho-byerekana ibikoresho bigabanya ubushyuhe na k kubindi bisobanuro, bikosora neza
Abakoresha API bahuza ibipimo bya top_p na top_k kugirango bagenzure uburyo ibyagezweho byintangarugero
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Nucleus and Top-k Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Icyitegererezo
Ibibazo bikunze kubazwa
What is Nucleus and Top-k Sampling?
Nucleus (top-p) hamwe na top-k icyitegererezo ni uburyo bwa decoding uburyo bwongeramo uburyo bwo kugenzura ibyanditswe muguhagarika ibimenyetso bishobora guhitamo. Ntacyo bitwaye kuko bituma AI yandika yumva ari karemano kandi itandukanye aho gusubiramo cyangwa robot.
Nigute top-k icyitegererezo kibuza guhitamo ibimenyetso?
Hejuru-k igabanya ikwirakwizwa ryumubare uhamye k wibimenyetso bishoboka cyane, bigahinduka, hamwe nicyitegererezo kivuye muribyo.
Niki gisobanura 'nucleus' muri nucleus (top-p) icyitegererezo?
Top-p ituma itsinda rito ryibimenyetso byo hejuru bifite amahirwe yo guhuriza hamwe bigera kumupaka p, hanyuma ingero muri zo.
Ni izihe nyungu zingenzi za top-p hejuru-k?
Umukandida wa Top-p agabanuka mugihe icyitegererezo cyizeye kandi kigakura mugihe kidashidikanywaho, bitandukanye na top-k yagenwe neza.
Niki ibipimo by'ubushyuhe bikora mbere yo gutoranya?
Ubushyuhe bwo hasi bwibanda kubishoboka hejuru yikimenyetso (more deterministic); ubushyuhe bwo hejuru buringaniza (buratandukanye).
Ni ukubera iki kurarikira kurarikira (buri gihe ikimenyetso cyo hejuru) akenshi bitifuzwa kubwinyandiko ifunguye?
Kurarikira kurarikira bikunze kugwa mubisubiramo kandi bikabura ubwoko butandukanye bugenzura icyitegererezo gitanga.