Nucleus ak Top-k
Nucleus (top-p) ak top-k sampling ay pexe decodage lañu yuy yokk aleatoire buñ saytu ci defar mbind ci tënk xeetu token yiñ mëna tànn.
Résumé
They matter because they make AI writing feel natural and varied instead of repetitive or robotic.
Plongeur bu xóot
Benn modelu làkk dafay génne distribution probabilite ci vocabulaire bi yépp ci jéego bu nekk. Sampling ci moom mën na tànnee ay jeton yu doywaar, yu am probabilite bu néew; saa yu nekk jël token bi gëna kawe (greedy) dafay defar ay bouclage yu tëx, yuy baamtu. Top-k sampling dafay saafara lii ci denc k token yi gëna am wërsëg (wax k = 40), renormalise, ak sampling ci seen biir. Échantillonnage nucléaire, bi Holtzman ak ñeneen ñi dugal. ci 2019, lu moy loolu dafay tëye ensemble bi gëna ndaw ci jetons yi seen probabilite cumulatif weesu p (lu melni, 0.9) - 'nucleus'. Njariñ li gëna mag mooy ensemble bi dafay wàññeeku su model bi wóolu boppam, ba noppi di yaatu su wóorul, di méngoo bu baax. Ñoom ñaar ñépp dañu leen di boole ak benn parametru tàngoor buy ñaw wala dakkal séddale bi laata ñuy jël misaal.
Gis-gis xarala
Seen wuutu bu am solo mooy dagg bu fiks bi ak dagg biy méngoo. Top-k dafay denc k tokens, te loolu mën na nekk lu néew sudee tànneef yu bari dañu am xel, wala boole ci junk sudee ñaar kese ñoo am xel. Top-p dafay denc nimero bu mën soppiku - ay token yu doy ngir muur masse probabilite p - moo tax dafay dagg geen gu gudd gi wóorul dara, boole ci sargal ni distribution bi tollu wala plat. Tàngoor (daanaka 0.7-1.0) dafay soppi logit yi balaa benn ci anam yi: valeur yu gëna ndaw dañuy concentrer probabilite, valeur yu gëna mag dañu koy tasaare.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu Nucleus ak Top-k
Decodage bi sukkandiko ci sampling mooy chatbot yi ak jumtukaayi sos mbir, te gëstu yi dañu koy wéy di setal: pexe yu melni sampling tipikal, min-p, ak sampling eta / epsilon dañu bëgga dagg geen gi gëna am xel, moo gën p wala k bu takku. Xaarandil dekodage parametre yi gëna xam contexte bi ba ci jàng, di gëna seere ci saasi ngir tontu yu dëggu yi ak loose ngir brainstorming. Lu model yi di gëna xarañ, dafay am solo lool ñu saytu sampling bi bu baax ngir mëna ekilibre wóor gi, wuute gi, ak wàññi hallucinations yi.
Doxal ci àdduna dëgg
Chatbots jëfandikoo top-p ci diggante 0.9 ngir tëye tontu yu wuute waaye lëkkaloo ci waxtaan wi
Jàppalekatu bind yu xarañ yi dañuy yokk tàngoor wi ak p ngir xalaat ci xalaati jaar-jaar yu bari
Jumtukaayi defar kode wàññi tàngoor ak k ngir gëna deterministik, snippets yu jaar yoon
Jëfandikukati API yi dañuy méngale top_p ak top_k ngir saytu ni génnug model bi di doxee
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Nucleus and Top-k Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
échantillonnage
Laaj yi ñuy faral di laaj
What is Nucleus and Top-k Sampling?
Nucleus (top-p) ak top-k sampling ay pexe decodage lañu yuy yokk aleatoire buñ saytu ci defar mbind ci tënk xeetu token yiñ mëna tànn. Dañu am solo ndax dañuy tax bind IA di nuru lu natureel te wuute ci barabu baamtu wala robot.
naka la top-k sampling di tënk tànneefi token yi?
Top-k dafay dagg séddale bi ci limu fixe k ci jeton yi gëna am wërsëg, renormalise, ak misaal ci ñoom.
Lan mooy 'nucleus' ci sampling nucleus (ci kaw-p)?
Top-p dafay tëye kuréel gi gëna ndaw ci top tokens yi nga xamni seen probabilite cumulatif yegg na ci p, suko defee ñu jël misaal ci ñoom.
Lan mooy njariñu top-p ci kaw top-k?
Top-p's candidat set dafay wàññeeku sudee model bi wóolu boppam ba noppi màgg sudee wóorul, wuute na ak top-k's count fixe.
Lan la parametru tamperatiir bi di def balaa ñuy jël échantillon?
Tàngoor wu woyof dafay dajale probabilite yi ci token yu kaw yi (gëna deterministik); tàngoor wu gëna yéeg dafay platre (gëna wuute).
Lan moo waral decodage bu seer (foo ko fekk token bi gëna kawe) du lu baax ci mbind yu ubbeeku yi?
Decodage bu bëgg lu bari dafay faral di tëju ci baamtu te amul bariwaayu naturel bi sampling buñ saytu di joxe.