Logit Bias
Logit bias ni ipfundo ryerekana urugero rwururimi rugana cyangwa kure yikimenyetso cyihariye wongeyeho umubare uhamye kumanota yabo mbere yuko icyitegererezo gitora ijambo rikurikira.
Incamake
It is a lightweight way to ban words, force choices, or shape style without retraining anything.
Kwibira cyane
Mbere yuko icyitegererezo gihitamo ikimenyetso gikurikiraho, gitanga logit (amanota adasanzwe) kuri buri kimenyetso mumagambo yacyo. Logit bias igufasha kongeramo agaciro gahoraho kumurongo wibimenyetso byatoranijwe numubare wabo wibimenyetso. Kubogama kwinshi kubogamye gutuma ikimenyetso gishobora kuba icyitegererezo; kubogama kwinshi (akenshi -100 muri APIs) birabuza neza. Kuberako ihinduka riba mbere ya softmax ihindura amanota mubishoboka, ndetse kubogama kworoheje guhindura guhindura kugabana. Icy'ingenzi, kubogama ni urufunguzo rwo kwerekana indangamuntu, ntabwo ari amagambo yose - bityo ijambo-ibimenyetso byinshi rishobora gukenera buri gice cyaryo kibogamye kugirango gihagarike cyangwa kibiteze imbere. Nuburyo bwihuse, bwo kubaga budasaba kuringaniza neza kandi bukurikizwa kubisabwa.
Ubushishozi
Logits ni amanota-afite agaciro nyako; softmax ibagaragaza, bityo kongeramo +5 mukimenyetso kigwiza uburemere budasanzwe na e ^ 5 (~ 148x) mbere yubusanzwe. Ongeraho -100 isunika post-softmax bishoboka cyane kuri zeru. Kuberako tokenizers ikoresha subword ibice, ijambo 'kutishima' rishobora kuba ibimenyetso bibiri; kubogama igice cyambere gusa ntabwo kizagenzura neza. Iyo subword granularity niyo gotcha nyamukuru mugihe abantu bagerageje guhagarika ijambo ryihariye kandi riracyatemba igice.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Logit Bias
Kubogama kubogamye bikomeje kuba intandaro yo kuyobora byihuse, ariko ubundi buryo bukize buragenda bwiyongera: decoding yubatswe / yubatswe kuburizamo ingwate zikomeye, hamwe na enterineti ikora cyangwa ihagarariwe na injeniyeri yerekana icyerekezo cyimbere aho gutanga amanota gusa. Tegereza APIs kugumya kubogama nkibisanzwe byoroshye guhunga mugihe utanga urwego rwohejuru rwo kugenzura - interuro zabujijwe, amabwiriza yuburyo, uburyo bwo kuyungurura umutekano - ikora tokenisation mu buryo bworoshye kugirango abayitezimbere batagomba gutekereza kubijyanye nindangamuntu mbisi.
Gushyira mu bikorwa Isi
Gushiraho -100 kubogama kubimenyetso byo gutukana kugirango wirinde chatbot guhora itanga amagambo amwe.
Guhatira yego / oya mubyiciro utanga kubogama gukomeye kubimenyetso bya 'Yego' na 'Oya' no guhagarika ibindi byose.
Guca intege interuro ikoreshwa cyane cyangwa ijambo ryuzuza ukoresheje kubogama kuringaniye kubimenyetso byayo.
Kuzamura imvugo yihariye (nkizina ryibicuruzwa) rero incamake irabivuga neza.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Logit Bias quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
ALiBi Umwanya Kubogama
Ibibazo bikunze kubazwa
What is Logit Bias?
Logit bias ni ipfundo ryerekana urugero rwururimi rugana cyangwa kure yikimenyetso cyihariye wongeyeho umubare uhamye kumanota yabo mbere yuko icyitegererezo gitora ijambo rikurikira. Nuburyo bworoshye bwo guhagarika amagambo, guhitamo imbaraga, cyangwa imiterere yimiterere nta kongera imyitozo.
Ni iki kubogama kubogamye bihindura?
Kubogama kubogamye byongeramo guhora kumurongo wibimenyetso byatoranijwe, uhindura uburyo bishoboka ko byatorwa, udahinduye icyitegererezo ubwacyo.
Muri API nyinshi, logit bias ya -100 kuri token ikora iki?
Kinini kubogama nka -100 itwara ikimenyetso cya post-softmax ishobora kuba kuri zeru, kubwibyo ntabwo yigeze ikorwa.
Ni ukubera iki guhagarika ijambo hamwe na logit bias rimwe na rimwe bisohora igice igice?
Tokenizers yagabanije amagambo menshi mubice byinshi byijambo ryibisobanuro, kubogama rero igice cyambere gusa binanirwa guhagarika ijambo ryuzuye.
Kubogama kubogamye ni urufunguzo rw'iki?
Indangagaciro zibogamye zikoreshwa kubiranga ibimenyetso byihariye biva mumagambo ya tokenizer, niyo mpamvu ugomba kumenya indangamuntu kubice byijambo.
Kuberako ibiti byanyuze muri softmax, ni izihe ngaruka zo kongeramo kubogama?
Softmax yerekana logits, kubwibyo rero no kubogama kworoheje kubogamye kugwiza ikimenyetso kidasanzwe uburemere budasanzwe, bikazamura cyane itandukaniro ryacyo.