Ururimi AI

Nucleus na Top-k Icyitegererezo

Nucleus (top-p) hamwe na top-k icyitegererezo ni uburyo bwa decoding uburyo bwongeramo uburyo bwo kugenzura ibyanditswe muguhagarika ibimenyetso bishobora guhitamo.

2 min somaIbiherutse kuvugururwa

Incamake

They matter because they make AI writing feel natural and varied instead of repetitive or robotic.

Kwibira cyane

Ururimi rwicyitegererezo rusohora ikwirakwizwa ryamagambo yose kuri buri ntambwe. Gutoranya biturutse kuri byo birashobora gutoranya ibintu bidasanzwe, ibimenyetso bike-bishoboka; burigihe gufata ikimenyetso cyo hejuru (umururumba) gitanga uduce twinshi, dusubiramo. Top-k icyitegererezo ikosora ibi ukomeza gusa k ibimenyetso byinshi bishoboka (vuga k = 40), guhindura ibintu, no gutoranya muri byo. Nucleus sampling, yatangijwe na Holtzman n'abandi. muri 2019, ahubwo igumisha urutonde ruto rwibimenyetso bifite amahirwe yo guhuriza hamwe kurenza p (urugero, 0.9) - 'nucleus'. Inyungu nyamukuru nuko iyi seti igabanuka mugihe icyitegererezo cyizeye kandi cyaguka mugihe kidashidikanywaho, gihuza imbaraga. Byombi bikunze guhuzwa nubushyuhe bwubushyuhe bukarisha cyangwa buringaniza ikwirakwizwa mbere yo gutoranya.

Ubushishozi

Itandukaniro rikomeye ryakosowe hamwe no guhuza n'imihindagurikire y'ikirere. Hejuru-k buri gihe ibika neza k ibimenyetso, birashobora kuba bike cyane mugihe amahitamo menshi yumvikana, cyangwa ushizemo imyanda mugihe abashakanye gusa bumvikana. Top-p ibika umubare uhinduka - gusa ibimenyetso bihagije kugirango bipfundikire misa p - bityo igabanya umurizo muremure utizewe mugihe wubaha uburyo bwo gukwirakwiza cyangwa hejuru. Ubushyuhe (mubisanzwe 0.7-1.0) bukuraho logi mbere yuburyo ubwo aribwo bwose: indangagaciro zo hasi zibanda kubishoboka, indangagaciro zo hejuru zirayikwirakwiza.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.

Kugera no kugera

Yagura uburyo bwindimi nuburyo bwo gutumanaho.

Ibyemezo bisobanutse

Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Kazoza ka Nucleus na Top-k Gutoranya

Gutoranya gushingira kuri decoding ubu nibisanzwe kuri chatbots nibikoresho byo guhanga, kandi ubushakashatsi bukomeza kubinonosora: uburyo nka sampling isanzwe, min-p, na eta / epsilon icyitegererezo kigamije guca umurizo mubwenge kuruta p cyangwa k ihamye. Tegereza ibipimo bya decoding kugirango urusheho kumenya imiterere-karemano ndetse wige, uhite ushimangira ibisubizo bifatika no kurekura ibitekerezo. Mugihe icyitegererezo kigenda gitera imbere, kugenzura byitondewe bikomeza kuba ingenzi mukuringaniza kwizerwa, gutandukana, no kugabanya salusiyo.

Gushyira mu bikorwa Isi

Ibiganiro ukoresheje top-p hafi 0.9 kugirango ibisubizo bikomeze ariko bihuze mubiganiro

Abafasha kwandika buhanga bazamura ubushyuhe na p kugirango bungurane ibitekerezo kubitekerezo bitandukanye

Ibikoresho-byerekana ibikoresho bigabanya ubushyuhe na k kubindi bisobanuro, bikosora neza

Abakoresha API bahuza ibipimo bya top_p na top_k kugirango bagenzure uburyo ibyagezweho byintangarugero

Ingaruka & Kurinda

Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.

Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.

Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Igishushanyo mbonera

1

Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.

2

Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.

3

Komeza kugenzura abantu kugenzura ibisubizo byinshi.

4

Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Nucleus and Top-k Sampling quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Icyitegererezo

Ibibazo bikunze kubazwa

What is Nucleus and Top-k Sampling?

Nucleus (top-p) hamwe na top-k icyitegererezo ni uburyo bwa decoding uburyo bwongeramo uburyo bwo kugenzura ibyanditswe muguhagarika ibimenyetso bishobora guhitamo. Ntacyo bitwaye kuko bituma AI yandika yumva ari karemano kandi itandukanye aho gusubiramo cyangwa robot.

Nigute top-k icyitegererezo kibuza guhitamo ibimenyetso?

Hejuru-k igabanya ikwirakwizwa ryumubare uhamye k wibimenyetso bishoboka cyane, bigahinduka, hamwe nicyitegererezo kivuye muribyo.

Niki gisobanura 'nucleus' muri nucleus (top-p) icyitegererezo?

Top-p ituma itsinda rito ryibimenyetso byo hejuru bifite amahirwe yo guhuriza hamwe bigera kumupaka p, hanyuma ingero muri zo.

Ni izihe nyungu zingenzi za top-p hejuru-k?

Umukandida wa Top-p agabanuka mugihe icyitegererezo cyizeye kandi kigakura mugihe kidashidikanywaho, bitandukanye na top-k yagenwe neza.

Niki ibipimo by'ubushyuhe bikora mbere yo gutoranya?

Ubushyuhe bwo hasi bwibanda kubishoboka hejuru yikimenyetso (more deterministic); ubushyuhe bwo hejuru buringaniza (buratandukanye).

Ni ukubera iki kurarikira kurarikira (buri gihe ikimenyetso cyo hejuru) akenshi bitifuzwa kubwinyandiko ifunguye?

Kurarikira kurarikira bikunze kugwa mubisubiramo kandi bikabura ubwoko butandukanye bugenzura icyitegererezo gitanga.