Izinga lokushisa kanye nesampula
Izinga lokushisa nesampula amadayili alawula ukuthi 'okungahleliwe' noma 'aphephe' kangakanani amagama emodeli yolimi.
Uhlolojikelele
They decide whether you get the same predictable answer every time or fresh, varied phrasing.
I-Deep Dive
Esinyathelweni ngasinye, imodeli yolimi ayikhiphi igama ngokuqondile — ikhiqiza amaphuzu ('ilogit') yawo wonke amathokheni kusilulumagama sayo, i-softmax eshintsha ibe ukusabalalisa okungenzeka. Ukusampula yindlela ithokheni elandelayo ekhethwa ngayo kulokho kusatshalaliswa. Izinga lokushisa lilungisa kabusha ukusatshalaliswa ngaphambi kokukhetha: izinga lokushisa eliphansi lenza ukukhetha okuphezulu kulawule, ngakho okukhiphayo kugxilile futhi kuphindaphindeka; izinga lokushisa eliphezulu liyayenza ibe isicaba, ivumele amathokheni angenakwenzeka ukuba angene ezinhlobonhlobo eziningi (namanye amaphutha). Izihlungi ezimbili ezidumile zinciphisa ichibi kuqala. I-Top-k igcina kuphela amathokheni angu-k okungenzeka kakhulu. I-Top-p, noma i-nucleus sampling, igcina isethi encane yamathokheni amathuba awo afinyelela ku-p (yithi 0.9), ngakho ichibi liyakhula lapho imodeli ingaqiniseki futhi incipha uma iqiniseka. Ngokuhlangene lezi zilungiselelo zihweba ngokwethembeka ngokumelene nokudala.
I-Technical Insight
Izinga lokushisa lisebenza ngokuhlukanisa ilogi ngayinye ngo-T ngaphambi kwe-softmax: amathuba alingana ne-exp(logit / T). T ngaphansi kuka-1 ulola izikhala ukuze ithokheni ephezulu ibuse; T ngenhla 1 incipha izikhala futhi inciphise ukusatshalaliswa. Ku-T eduze no-0 imodeli iba nomhobholo, ihlale ithatha ithokheni eyodwa okungenzeka kakhulu. I-Top-k ihlanganisa isibalo sekhandidethi enombolweni engashintshi, kuyilapho i-top-p isetha ukunqamuka kwamathuba akhulayo, ngakho isibalo sekhandidethi lakhona sivumelana nendlela imodeli eqiniseka ngayo kuleso sinyathelo.
I-Strategic Impact
Isivinini nesikali
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana.
Finyelela futhi ufinyelele
Yandisa ukufinyelela kuzo zonke izilimi nezitayela zokuxhumana.
Izinqumo ezicacile
Amaqembu angachitha isikhathi esiningi ekwahluleleni kuyilapho i-automation isingatha impinda.
Ikusasa Lezinga Lokushisa Nesampula
Lezi zilawuli zizinzile futhi ziqondwa kahle, ngakho-ke isenzo singokwakhona okuzenzakalelayo okuhlakaniphile nokuhlukile okusha. Lindela izikimu eziguquguqukayo ezengeziwe njenge-min-p (esikala ukunqamuka kumathuba ethokheni aphezulu) kanye nezinga lokushisa eliguqukayo elishintsha phakathi nesizukulwane. Ithuluzi lizokhula ngokuzenzakalelayo ukukhetha izilungiselelo ngomsebenzi ngamunye - aphansi ngekhodi nokukhipha, aphakeme ngokuhlangana kwengqondo - ukuze abasebenzisi bangavumi ukushuna ngesandla. Umbono owumongo uyabekezelela: isampuli iyifindo elilula, elinamandla phakathi kokunemba kwe-deterministic kanye nezinhlobonhlobo zokudala.
Ukuqaliswa Komhlaba Wangempela
Ukusetha izinga lokushisa eliseduze no-0 lokukhiqiza ikhodi noma ukukhipha idatha, lapho ufuna khona impendulo efanayo ngaso sonke isikhathi
Ukwenyusa izinga lokushisa lifinyelele cishe ku-0.8-1.0 ukuze kuqoqwe amagama, iziqubulo, noma imibono yezindaba ukuze uthole izinketho ezihlukahlukene
Ukusebenzisa i-top-p cishe ku-0.9 ukuze imodeli isampula kumagama azwakalayo kuphela futhi igwema amathokheni ayinqaba
Ukusebenzisa i-top-k kumakhandidethi futhi kuvimbele amagama ayivelakancane, angekho esihlokweni ukuthi avele empendulweni ebhekene nekhasimende.
Izingozi & Guardrails
Amaqiniso akhonjiwe angafaka ngokuthula imibiko, ukugeleza kosekelo, noma imiphumela yocwaningo.
Ukuzwela okusheshayo kungadala imiphumela engahambisani kuzo zonke izicelo ezifanayo.
Idatha yombhalo ebucayi ingase idalulwe uma izilawuli zokufinyelela zibuthakathaka.
Ukuqalisa Umhlahlandlela
Chaza ifomethi yokuphumayo, ithoni, namazinga wekhwalithi ngaphambi kokukhishwa.
Izimpendulo eziyisisekelo ngemithombo ethembekile noma nini lapho ukunemba kubalulekile.
Gcina indawo yokuhlola isibuyekezo somuntu ukuze uthole imiphumela ephezulu.
Landela amaphethini okuhluleka futhi uqeqeshe kabusha imiyalo noma ukuhamba komsebenzi njalo.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Temperature and Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-Nucleus ne-Top-k Sampling
Imibuzo evame ukubuzwa
What is Temperature and Sampling?
Izinga lokushisa nesampula amadayili alawula ukuthi 'okungahleliwe' noma 'aphephe' kangakanani amagama emodeli yolimi. Banquma ukuthi uthola impendulo efanayo ebikezelwayo ngaso sonke isikhathi noma amabinzana amasha, ahlukahlukene.
Kwenzani ukuphakamisa izinga lokushisa kokuphumayo kwemodeli?
Izinga lokushisa eliphakeme linciphisa ukusatshalaliswa kwamathuba, ngakho-ke amathokheni cishe cishe athathwa kaningi, akhiqize okukhiphayo okuhlukahlukene (nobungozi).
Ingabe isampula ye-top-p (nucleus) ihluke kanjani ekuthathweni kwe-top-k?
I-Top-p ivumelanisa ikhandidethi elimiswe ngamathuba akhulayo, kuyilapho i-top-k ihlala igcina inombolo egxilile yamathokheni aphezulu.
Ngokwemishini, izinga lokushisa lenzani ngempela kulogithi?
Izinga lokushisa lihlukanisa ilogi ngayinye ngo-T ngaphambi kwe-softmax; U-T ngaphansi kuka-1 ulola ukusabalalisa, u-T ngaphezulu kuka-1 uyawenza isicaba.
Ngokukhiqiza ikhodi noma ukukhipha idatha ehlelekile, isiphi isilungiselelo esivame ukuba ngcono?
Imisebenzi edinga ukulunga nokuphindaphinda isebenzisa izinga lokushisa eliphansi kakhulu ukuze imodeli ikhethe ngokuthembekile amathokheni okungenzeka kakhulu, alungile.
Kwenzekani ezingeni lokushisa ngempumelelo 0?
Eduzane nezinga lokushisa elinguziro, ukusatshalaliswa kubukhali kangangokuthi ithokheni yamathuba aphezulu kakhulu ihlale ikhethwa - ukukhishwa kwamakhodi okuhahayo.