Logit ele mmadụ anya n'ihu
Mkparịta ụka Logit bụ mkpịsị aka na-atụgharị ụdị asụsụ n'akụkụ ma ọ bụ pụọ na akara ngosi dị iche iche site n'ịgbakwunye nọmba edobere na akara ha tupu ihe nlereanya ahụ ahọrọ okwu na-esote.
Nchịkọta
It is a lightweight way to ban words, force choices, or shape style without retraining anything.
Ime miri emi
Tupu ihe nlereanya ahọrọ akara na-esote ya, ọ na-ewepụta akara ngosi (akara na-adịghị mma) maka akara ọ bụla n'ime okwu ya. Mkparịta ụka Logit na-enye gị ohere itinye uru mgbe niile na logiti nke akara ngosi ahọpụtara site na NJ akara ọnụọgụ ha. Nnukwu nhụsianya dị mma na-eme ka akara ngosi nwee ike ịlele; nnukwu echiche ọjọọ (mgbe -100 na API) na-amachibido ya nke ọma. N'ihi na ngbanwe ahụ na-eme tupu softmax nke na-atụgharị akara ka ọ bụrụ ihe gbasara puru omume, ọbụlagodi nhụsianya dị obi umeala na-agbanwe nkesa. N'ụzọ dị mkpa, a na-etinye echiche ọjọọ ahụ ka ọ bụrụ akara ngosi akara, ọ bụghị okwu zuru oke - ya mere okwu nwere ọtụtụ ihe nwere ike ịchọ nke ọ bụla n'ime ibe ya nwere mmasị na-ekpochapụ ma ọ bụ kwalite ya. Ọ bụ njikwa ngwa ngwa, njikwa ịwa ahụ nke na-achọghị nhazigharị nke ọma ma na-emetụta arịrịọ ọ bụla.
Nghọta nka nka
Logits bụ akara bara uru n'ezie; softmax na-akọwapụta ha, ya mere ịgbakwụnye +5 na token na-amụba ịdị arọ ya na-adịghị mma site na e^5 (~ 148x) tupu ịhazi ya. Ịtinye -100 na-akpali ike ya post-softmax na efu efu. N'ihi na tokenizers na-eji nkeji obere okwu, okwu 'enweghị obi ụtọ' nwere ike ịbụ akara abụọ; ime naanị akụkụ nke mbụ agaghị ejikwa ya nke ọma. Mkpụrụ okwu obere okwu ahụ bụ isi gotcha mgbe ndị mmadụ na-anwa machibido otu okwu ma ọ ka na-agbapụta n'akụkụ ụfọdụ.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke Logit Bias
Mkparịta ụka Logit ka bụ isi ihe maka ịkwọ ụgbọ ngwa ngwa, mana ụzọ ndị ọzọ bara ụba na-eto eto: ahaziri ahazi/amachibidoro maka nkwenye siri ike, yana njikwa ọrụ ma ọ bụ injinia nnọchite nke na-eme ka vector dị n'ime ihe nlereanya kama ịwepụta naanị akara. Na-atụ anya ka API dowe mkparị logt dị ka ụzọ mgbapụ dị mfe ka ha na-enye njikwa ọkwa dị elu - nkebi ahịrịokwu amachibidoro, ntuziaka ụdị, nzacha nchekwa - nke na-ejikwa tokenization na-akpaghị aka ka ndị mmepe ghara iche echiche gbasara ID token raw.
Mmejuputa n'ezie n'ụwa
Ịtọlite nhụsianya -100 na akara okwu rụrụ arụ iji gbochie chatbot imepụta ụfọdụ mkpụrụokwu.
Na-amanye ee / mba classifier site n'inye ezigbo mma n'ihu na akara 'Ee' na 'Mba' na igbochi ihe ọ bụla ọzọ.
Na-akụda akpaokwu ma ọ bụ okwu ndochi emebiela site n'itinye nhụsianya adịghị mma na akara ya.
Na-akwalite usoro ngalaba-kpọmkwem (dị ka aha ngwaahịa) yabụ onye nchịkọta akụkọ na-ekwukwa ya nke ọma.
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Logit Bias quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ọnọdụ ALiBi
Ajụjụ a na-ajụkarị
What is Logit Bias?
Mkparịta ụka Logit bụ mkpịsị aka na-atụgharị ụdị asụsụ n'akụkụ ma ọ bụ pụọ na akara ngosi dị iche iche site n'ịgbakwunye nọmba edobere na akara ha tupu ihe nlereanya ahụ ahọrọ okwu na-esote. Ọ bụ ụzọ dị mfe iji machibido okwu, ịmanye nhọrọ, ma ọ bụ ịkpụzi ụdị n'azụghachighị ihe ọ bụla.
Kedu ihe nhụsianya logit na-agbanwe?
Mkparịta ụka Logit na-agbakwụnye mgbe niile na logits nke akara ngosi akara ahọpụtara, na-agbanwe ka ọ ga-esi ahọrọ ha, na-agbanweghị ihe nlereanya n'onwe ya.
N'ọtụtụ API, kedu ihe nhụsianya logit nke -100 na akara ngosi na-arụzu?
Nnukwu nhụsianya na-adịghị mma dị ka -100 na-ebuli ohere nke post-softmax token ka ọ bụrụ efu, yabụ na ọ naghị emepụta ya.
Kedu ihe kpatara machibido otu okwu nwere nhụsianya logit nwere ike mgbe ụfọdụ wepụta mpụta akụkụ?
Tokenizers na-ekewa ọtụtụ okwu n'ime ọtụtụ akara okwu obere okwu, yabụ na-eleda naanị ibe mbụ adịghị ebelata okwu ahụ n'uju.
Kedu ihe njirimara ka etinyere nhụsianya logit?
A na-etinye ụkpụrụ nhụsianya n'ọrụ na akara ngosi akara akọwapụtara nke sitere na okwu tokenizer, nke mere na ị ga-amarịrị NJ maka iberibe okwu.
N'ihi na a na-agafe logit site na softmax, kedu ihe mmetụta nke ịgbakwunye echiche ziri ezi?
Softmax na-akọwapụta logit, yabụ ọbụlagodi nhụsianya dị mma na-abawanye ibu nke akara ngosi na-adịghị mma nke ukwuu, na-ewelite nke ọma.