Ururimi AI

Ubushyuhe no Guhitamo

Ubushyuhe hamwe nicyitegererezo ni imvugo igenzura uburyo 'bidashoboka' cyangwa 'umutekano' imvugo y'ururimi imvugo.

2 min somaIbiherutse kuvugururwa

Incamake

They decide whether you get the same predictable answer every time or fresh, varied phrasing.

Kwibira cyane

Kuri buri ntambwe, imvugo yururimi ntisohora ijambo muburyo butaziguye - itanga amanota ('logit') kuri buri kimenyetso mumagambo yacyo, softmax ihinduka ikwirakwizwa rishoboka. Icyitegererezo nuburyo ikimenyetso gikurikira cyatoranijwe muri uko kugabana. Ubushyuhe buvugurura isaranganya mbere yo guhitamo: ubushyuhe buke butuma amahitamo yo hejuru yiganje, ibisohoka rero byibanda kandi bisubirwamo; ubushyuhe bwo hejuru buringaniza, kureka ibimenyetso bidashoboka kunyerera kubwinshi butandukanye (kandi amakosa menshi). Akayunguruzo kazwi cyane kagabanya ikidendezi mbere. Hejuru-k ibika gusa k ishoboka-yerekana ibimenyetso. Top-p, cyangwa nucleus sampling, ikomeza urutonde ruto rwibimenyetso bishoboka ko byiyongera kuri p (vuga 0.9), pisine rero ikura mugihe icyitegererezo kidashidikanywaho kandi kigabanuka mugihe cyizeye. Hamwe na hamwe igenamiterere rigurisha kwizerwa kurwanya guhanga.

Ubushishozi

Ubushyuhe bukora mukugabanya buri logit na T mbere ya softmax: ibishoboka biragereranywa na exp (logit / T). T munsi ya 1 ityaza icyuho kugirango ikimenyetso cyo hejuru kiganje; T hejuru ya 1 igabanya icyuho kandi igorora ikwirakwizwa. Kuri T hafi 0 icyitegererezo gihinduka umururumba, burigihe ufata ikimenyetso kimwe gishoboka. Top-k yerekana umubare wabakandida ku mubare uteganijwe, mugihe top-p ishyiraho igiteranyo-gishoboka cyo guhagarika, bityo umubare wabakandida bayo uhuza nuburyo icyitegererezo kiri kuri iyo ntambwe.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.

Kugera no kugera

Yagura uburyo bwindimi nuburyo bwo gutumanaho.

Ibyemezo bisobanutse

Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Ejo hazaza h'ubushyuhe no gutoranya

Igenzura rihamye kandi ryumvikana neza, igikorwa rero kiri mubwenge buke nibisanzwe bishya. Tegereza gahunda nyinshi zijyanye no guhuza n'imihindagurikire y'ikirere nka min-p (igabanya kugabanuka kugeza hejuru ya token ishoboka) hamwe n'ubushyuhe bukabije buhindura ibisekuruza. Igikoresho kizagenda cyiyongera-gutoranya igenamigambi kuri buri gikorwa - hasi ya code no kuyikuramo, hejuru yo kungurana ibitekerezo - bityo abakoresha ntibazahuza intoki. Igitekerezo cyibanze cyihanganira: icyitegererezo nikintu cyoroshye, gikomeye gikomeye hagati yuburyo bugaragara no guhanga ibintu bitandukanye.

Gushyira mu bikorwa Isi

Gushiraho ubushyuhe hafi 0 yo kubyara code cyangwa gukuramo amakuru, aho ushaka igisubizo kimwe cyukuri buri gihe

Kuzamura ubushyuhe bugera kuri 0.8-1.0 kugirango bungurane ibitekerezo ku mazina, amagambo, cyangwa ibitekerezo byinkuru kugirango ubone amahitamo atandukanye

Koresha top-p hafi 0.9 rero icyitegererezo cyicyitegererezo kiva mumagambo yemewe gusa kandi wirinde ibimenyetso bidasanzwe

Koresha top-k kugirango utsindire abakandida kandi wirinde amagambo adasanzwe, adashingiye kumutwe kugaragara mubisubizo byabakiriya

Ingaruka & Kurinda

Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.

Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.

Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Igishushanyo mbonera

1

Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.

2

Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.

3

Komeza kugenzura abantu kugenzura ibisubizo byinshi.

4

Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Temperature and Sampling quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Nucleus na Top-k Icyitegererezo

Ibibazo bikunze kubazwa

What is Temperature and Sampling?

Ubushyuhe hamwe nicyitegererezo ni imvugo igenzura uburyo 'bidashoboka' cyangwa 'umutekano' imvugo y'ururimi imvugo. Bahitamo niba ubona igisubizo kimwe giteganijwe buri gihe cyangwa gishya, interuro zitandukanye.

Niki kuzamura ubushyuhe bikora kumusaruro wicyitegererezo?

Ubushyuhe bwo hejuru buringaniza ikwirakwizwa ryikwirakwizwa, bityo ibimenyetso-bidashoboka ibimenyetso byatoranijwe kenshi, bikabyara umusaruro utandukanye (na riskier).

Nigute top-p (nucleus) icyitegererezo gitandukanye na top-k icyitegererezo?

Hejuru-p ihuza umukandida washyizweho nuburyo bushoboka, mugihe top-k ihora igumana umubare uhamye wibimenyetso byo hejuru.

Muburyo bwa tekiniki, mubyukuri ubushyuhe bukora iki kuri logi?

Ubushyuhe bugabanya buri logit na T mbere ya softmax; T munsi ya 1 ityaza isaranganya, T hejuru ya 1 irayitunganya.

Kubyara kode cyangwa gukuramo amakuru yubatswe, ni ubuhe buryo busanzwe ari bwiza?

Inshingano zikeneye gukosorwa no gusubiramo zikoresha ubushyuhe buke cyane kuburyo moderi itoranya byimazeyo ibimenyetso bishoboka, bikosora.

Bigenda bite ku bushyuhe bwa 0 neza?

Hafi yubushyuhe bwa zeru, ikwirakwizwa rirakaze kuburyo ibimenyetso-bishoboka cyane byerekana ibimenyetso - guhitamo umururumba.