Ubushyuhe no Guhitamo
Ubushyuhe hamwe nicyitegererezo ni imvugo igenzura uburyo 'bidashoboka' cyangwa 'umutekano' imvugo y'ururimi imvugo.
Incamake
They decide whether you get the same predictable answer every time or fresh, varied phrasing.
Kwibira cyane
Kuri buri ntambwe, imvugo yururimi ntisohora ijambo muburyo butaziguye - itanga amanota ('logit') kuri buri kimenyetso mumagambo yacyo, softmax ihinduka ikwirakwizwa rishoboka. Icyitegererezo nuburyo ikimenyetso gikurikira cyatoranijwe muri uko kugabana. Ubushyuhe buvugurura isaranganya mbere yo guhitamo: ubushyuhe buke butuma amahitamo yo hejuru yiganje, ibisohoka rero byibanda kandi bisubirwamo; ubushyuhe bwo hejuru buringaniza, kureka ibimenyetso bidashoboka kunyerera kubwinshi butandukanye (kandi amakosa menshi). Akayunguruzo kazwi cyane kagabanya ikidendezi mbere. Hejuru-k ibika gusa k ishoboka-yerekana ibimenyetso. Top-p, cyangwa nucleus sampling, ikomeza urutonde ruto rwibimenyetso bishoboka ko byiyongera kuri p (vuga 0.9), pisine rero ikura mugihe icyitegererezo kidashidikanywaho kandi kigabanuka mugihe cyizeye. Hamwe na hamwe igenamiterere rigurisha kwizerwa kurwanya guhanga.
Ubushishozi
Ubushyuhe bukora mukugabanya buri logit na T mbere ya softmax: ibishoboka biragereranywa na exp (logit / T). T munsi ya 1 ityaza icyuho kugirango ikimenyetso cyo hejuru kiganje; T hejuru ya 1 igabanya icyuho kandi igorora ikwirakwizwa. Kuri T hafi 0 icyitegererezo gihinduka umururumba, burigihe ufata ikimenyetso kimwe gishoboka. Top-k yerekana umubare wabakandida ku mubare uteganijwe, mugihe top-p ishyiraho igiteranyo-gishoboka cyo guhagarika, bityo umubare wabakandida bayo uhuza nuburyo icyitegererezo kiri kuri iyo ntambwe.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'ubushyuhe no gutoranya
Igenzura rihamye kandi ryumvikana neza, igikorwa rero kiri mubwenge buke nibisanzwe bishya. Tegereza gahunda nyinshi zijyanye no guhuza n'imihindagurikire y'ikirere nka min-p (igabanya kugabanuka kugeza hejuru ya token ishoboka) hamwe n'ubushyuhe bukabije buhindura ibisekuruza. Igikoresho kizagenda cyiyongera-gutoranya igenamigambi kuri buri gikorwa - hasi ya code no kuyikuramo, hejuru yo kungurana ibitekerezo - bityo abakoresha ntibazahuza intoki. Igitekerezo cyibanze cyihanganira: icyitegererezo nikintu cyoroshye, gikomeye gikomeye hagati yuburyo bugaragara no guhanga ibintu bitandukanye.
Gushyira mu bikorwa Isi
Gushiraho ubushyuhe hafi 0 yo kubyara code cyangwa gukuramo amakuru, aho ushaka igisubizo kimwe cyukuri buri gihe
Kuzamura ubushyuhe bugera kuri 0.8-1.0 kugirango bungurane ibitekerezo ku mazina, amagambo, cyangwa ibitekerezo byinkuru kugirango ubone amahitamo atandukanye
Koresha top-p hafi 0.9 rero icyitegererezo cyicyitegererezo kiva mumagambo yemewe gusa kandi wirinde ibimenyetso bidasanzwe
Koresha top-k kugirango utsindire abakandida kandi wirinde amagambo adasanzwe, adashingiye kumutwe kugaragara mubisubizo byabakiriya
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Temperature and Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Nucleus na Top-k Icyitegererezo
Ibibazo bikunze kubazwa
What is Temperature and Sampling?
Ubushyuhe hamwe nicyitegererezo ni imvugo igenzura uburyo 'bidashoboka' cyangwa 'umutekano' imvugo y'ururimi imvugo. Bahitamo niba ubona igisubizo kimwe giteganijwe buri gihe cyangwa gishya, interuro zitandukanye.
Niki kuzamura ubushyuhe bikora kumusaruro wicyitegererezo?
Ubushyuhe bwo hejuru buringaniza ikwirakwizwa ryikwirakwizwa, bityo ibimenyetso-bidashoboka ibimenyetso byatoranijwe kenshi, bikabyara umusaruro utandukanye (na riskier).
Nigute top-p (nucleus) icyitegererezo gitandukanye na top-k icyitegererezo?
Hejuru-p ihuza umukandida washyizweho nuburyo bushoboka, mugihe top-k ihora igumana umubare uhamye wibimenyetso byo hejuru.
Muburyo bwa tekiniki, mubyukuri ubushyuhe bukora iki kuri logi?
Ubushyuhe bugabanya buri logit na T mbere ya softmax; T munsi ya 1 ityaza isaranganya, T hejuru ya 1 irayitunganya.
Kubyara kode cyangwa gukuramo amakuru yubatswe, ni ubuhe buryo busanzwe ari bwiza?
Inshingano zikeneye gukosorwa no gusubiramo zikoresha ubushyuhe buke cyane kuburyo moderi itoranya byimazeyo ibimenyetso bishoboka, bikosora.
Bigenda bite ku bushyuhe bwa 0 neza?
Hafi yubushyuhe bwa zeru, ikwirakwizwa rirakaze kuburyo ibimenyetso-bishoboka cyane byerekana ibimenyetso - guhitamo umururumba.