échantillonnage
Sampling bu ñuy gëna xam mooy anam wi ñuy defaree mbind, mooy tànnee baat bi ci topp ci ay token yu ëmbiitu xibaar bi jege surprise bi model bi di seentu, moo gën ñuy jël li gëna am wërsëg.
Résumé
It aims for output that feels natural and human-like by matching how real language balances predictability and novelty.
Plongeur bu xóot
Su benn modelu làkk waxee token bi ci topp, dafay defar distribution probabilite ci kaw ay junni tànneef. Greedy ak top-k pexe yi dañu taamu jeton yu am probabilite bu rëy, te loolu mën na tax bind bi di baamtu te neex. Sampling bu ñuy gëna xam, bi Meister ak ay naataango dugal ci 2022, dafay jël beneen angle bu juddoo ci theorie information. Royuwaay bi dafay xayma ëmbiitu xibaar bi ñuy seentu (entropi bu séddale bi). Tokens yi deñukoy poñ ci fu seen surprise bopp toogee ci li ñuy seentu. Échantillonnage bi ñuy faral di def mooy tëye ensemble jeton yi surprise bi gëna jege moyenne bi ba seen probabilite boole dem ba ci benn threshold, su ko defee échantillons yi ci ensemble boobu. Lépp soo ko boolee mu nekk bind bu amul benn anam buñu mëna wax luy xew, di wane ni nit ñi di jokkoo ci seen bopp, ci anam wu amul benn werante.
Gis-gis xarala
Ngir bépp jeton kandidaa, model bi dafay xayma jaaxle, log-probabilite bu baaxul bi. Dafay xayma itam entropi bi war, di surprise moyenne buñ pondéree ci probabilite ci kaw jeton yépp. Sampling bu gëna bari dafay rang token yi ci wuute absolu bi am ci digganté seen surprise ak entropie bi, ba noppi ñu yokk token yi gëna jege ba seen probabilite cumulatif dem ba ci parametre tau (dafay faral di tollu ci 0.9 ba 0.95). Sampling du am ludul ci biir ensemble bi gëna mag ci gox bi, di dindi outliers yu tar yi ak tànneef yu am probabilite bu rëy yi.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu jël misaal
Sampling bu gëna bari mingi nekk tànneef buñ miin ci wetu top-p ak top-k ci stack yu ubbeeku yu melni llama.cpp ak Transformatëri kanam yuy laxasu. Xaarandi jëfandikoo gi gëna bari ci bind yu am gis-gis, waxtaan, ak defar ay jaar-jaar, fu dekodage bu wóorul lool di yàq kalite bi. Gëstukat yi dañu koy boole ak ay threshold yuy méngoo ak jamono ju nekk, ba noppi boole ci ay daan ngir baamtu. Bi dekodaasu theorie-info bi di màgg, sampling tipikal mën na joxe leeral ci anam wu otomatik, xam-xam ci séddale biy dindi jekkal tàngoor yiñ defaree loxo.
Doxal ci àdduna dëgg
Defar fiksioŋ wala taalif fu dekodaas bu ñàkka doytu di defar prose bu tëx, baamtu te bindkat yi dañu bëgg bariwaayu mbir yu wuute.
Tontu chatbot yu am doole yi nga moytu wax lu robot, formulaic boole ci nekk ci topic bi.
Amna ci ni darapo dekodaas (typical_p) ci Transformatëri kanam yuy laxasu ngir defarkat yiy ajuste génnug modelu open-source.
Jëfandikoo ci LLM bi ci dëkk bi lu melni llama.cpp ak text-generation-webui ngir wuutu top-p ngir mbind yu gëna riis te gëna néew luñu yàqu.
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Typical Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Saytu misaalu xalaat
Laaj yi ñuy faral di laaj
What is Typical Sampling?
Sampling bu ñuy gëna xam mooy anam wi ñuy defaree mbind, mooy tànnee baat bi ci topp ci ay token yu ëmbiitu xibaar bi jege surprise bi model bi di seentu, moo gën ñuy jël li gëna am wërsëg. Li muy fexe mooy génne ay mbir yu melni lu natureel te nuru nit, ci méngoo ak ni làkk dëgg di boolee luñu mëna wax luy am ak lu bees.
Ban limu core la échantillonnage bu ñuy méngale ak token bu nekk ci kàndidaa yi?
Sampling bu gëna bari mooy natt fu surprise token bu nekk sori ci entropie distribution bi, ëmbiitu xibaar bi ñuy seentu, tëye token yi surprise bi gëna jege moyenne bi.
naka la sampling tipik di def ci token bi gëna am wërsëg?
Jeton bu am probabilite bu rëy lool amna surprise bu tuuti lool, te loolu mën na sori ci moyenne bi, kon sampling tipikal mën nako bàyyi ci bitti kàndidaa biñ tànn ngir gëna 'tipikal' jetons.
Ban xalaat ci làkku doomi aadama yi moo waral ñu jël misaal bi?
Xeetu xam-xam bi dafa sukkandiko ci xalaat biy wax ni làkk wiñ nàmp dafay jege tolluwaayu xibaar buñ yamale, moo tax dafay taamu token yi yor surprise bu jege-ci-moyenne.
Lan mooy parametru tau bi ci saytu echantillonnage bi?
Tau mooy tëral probabilite kumulatif biñ bëgga am; token yi gëna jege entropi bi dañu leen di yokk ba seen probabilite boole yegg tau, di fësal ensemble bi ñuy jël misaal.
Ci ban xeetu losisel lañuy faral di wane sampling bi ci developpeur yi?
Dañuy jëfandikoo misaal bi gëna bari ci dekodage (ci misaal typical_p) ci bibliotek yu melni Transformatëri kanam yuy laxasu ak waxtu doxal yu melni llama.cpp.