Tàngoor ak jël misaal
Tamperatiir ak sampling ñooy màndarga yiy saytu ni kàddu yu modelu làkk yi di 'baaxe' wala 'am kaaraange'.
Résumé
They decide whether you get the same predictable answer every time or fresh, varied phrasing.
Plongeur bu xóot
Ci jéego bu nekk, xeetu làkk du génne benn baat ci saasi - dafay defar poñ ('logit') ngir bépp token ci vocabulaire bi, softmax daf koy soppi def ko distribution probabilite. Sampling mooy anam wi ñuy tànnee token bi ci topp ci séddale boobu. Tàngoor dafay soppi jëmmu séddale bi balaa muy tànn: tàngoor wu woyof mooy tax tànneef yi gëna am doole, kon génne gi dafay fokalise te mën nañu ko baamtu; tàngoor wu metti daf koy dakkal, bàyyi ay jeton yu nuruwul ñu dugg ngir bari xeetu (ak njuumte yu bari). Ñaari filtre yu siiw ñooy njëkka tëj piscine bi. Top-k du denc k token yi gëna am wërsëg. Top-p, wala sampling nucleus, dafay tëye ensemble bi gëna ndaw ci jetons yi nga xamni probabilite yi dañuy yokk ba p (wax 0.9), kon pool bi dafay màgg su model bi wóorul, ba noppi di wàññeeku su wóolu boppam. Jekkal yooyu yépp dañuy xajamal wóor ak sos lu bees.
Gis-gis xarala
Tamperatiir dafay dox ci séddale logit bu nekk ak T balaa softmax: wërsëg mingi méngoo ak exp (logit / T). T ci suufu 1 dafay ñaw bërëb yi suko defee token bi ci kaw di ëpp doole; T ci kaw 1 dafay wàññi bërëb yi ba noppi dakkal séddale bi. Ci T ci wetu 0 model bi dafay nekk lu bëgg lu bari, saa yu nekk dafay jël token bi gëna am wërsëg. Top-k dafay tënk limu kàndidaa yi ci benn nimero buñ tëral, fekk top-p dafay tëral dagg-probabilite cumulatif, suko defee limu kàndidaa yi méngoo ak ni model bi wóolu boppam ci jéego boobu.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu tàngoor ak jël misaal
Kontrol yooyu dañu dëgër te ñu xam leen bu baax, kon jëf ji dafa nekk ci default yu gëna xarañ ak ci anam yu bees. Xaarandil ay pexe yu gëna méngoo ak min-p (biy dagg ci probabilite token bi gëna kawe) ak tàngoor buy soppiku ci diggu jamono. Jumtukaay dina gëna tann ci boppam jekkal yi ci liggéey bu nekk - wàññeeku ngir kode ak génne, gëna kawe ngir brainstorming - kon jëfandikukat yi duñu tune ak loxo. Xalaat bi am solo mooy: sampling mooy butoŋu bu yomb bi am doole diggante njub ak bariwaayu sos lu bees.
Doxal ci àdduna dëgg
Regler tàngoor ci wetu 0 ngir defar kode wala génne ay done, nga bëgg benn tontu bu jaar yoon saa yu nekk
Yokkatal tàngoor wi ba ci diggante 0.8-1.0 ngir xalaat ci tur yi, slogan yi, wala xalaati jaar-jaar yi ngir am tànneef yu bari
Jëfandikoo top-p ci diggu 0.9 suko defee model bi jël misaal ci kàddu yi gëna wóor te moytu ay jeton yu doy waar
Jëfandikoo top-k ngir tënk kàndidaa yi te moytu kàddu yu bariwul, yu génn ci topic bi feeñ ci tontub kiliyaan bi
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Temperature and Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Nucleus ak Top-k
Laaj yi ñuy faral di laaj
What is Temperature and Sampling?
Tamperatiir ak sampling ñooy màndarga yiy saytu ni kàddu yu modelu làkk yi di 'baaxe' wala 'am kaaraange'. Ñoom ñooy xool ndax saa yu nekk dangay am benn tontu buñu mëna seentu wala nga joxe kàddu yu bees te wuute.
Lan mooy yokk tàngoor wi ci génnug model bi?
Tàngoor wu gëna rëy dafay platre distribution probabilite, moo tax token yu gëna néew probabilite dañuy gëna faral di tann, di defar ay produit yu bari te wuute (ak riskant).
Lan moo wuutale top-p (nucleus) ak top-k?
Top-p dafay méngale kàndidaa yiñ tëral ci probabilite cumulatif, fekk top-k dafay tëye saa yu nekk limu top tokens yi.
Ci wàllu mekanik, lan la tàngoor di def ci logit yi?
Tàngoor dafay xaaj logit bu nekk ak T balaa softmax; T ci suufu 1 dafay ñaw séddale bi, T ci kaw 1 dafay platre.
Ngir defar kode wala génne ay done yuñ jagleel, ban jekkal moo gëna baax?
Liggéey yi soxla njub ak baamtu jëfandikoo tàngoor wu woyof lool suko defee model bi tànnee ci anam wu wóor, token yu gëna jub.
Lan mooy xew su tàngoor wi yeggee 0?
Ci wetu tàngoor bu amul dara, séddale bi dafa ñaw ba sax ñuy tànn token bi gëna am wërsëg - dekodaas bu bëgg lu bari.