Ntụgharị prefix
Ndozigharị ihe nrịbama bụ ụzọ na-arụ ọrụ nke ọma iji megharia ụdị asụsụ oyi kpọnwụrụ site n'ịzụ obere usoro vector na-aga n'ihu nke na-akwadodo maka ntinye oyi akwa ọ bụla.
Nchịkọta
It lets you customize giant models for new tasks while updating less than 1% of parameters.
Ime miri emi
Ntugharị ihe nrịbama, nke ndị nyocha Stanford Li na Liang webatara na 2021, na-emegharị ihe ngbanwe a zụrụ azụ na-emetụghị ibu ya aka. Kama ịhazigharị paramita niile nke ọma, ọ na-emepe usoro nke 'virtual tokens' ( prefix) na igodo na ụkpụrụ na oyi akwa ọ bụla. Ụdị oyi kpọnwụrụ na-aga na nganiihu a dị ka a ga-asị na ọ bụ ihe gbara ya gburugburu, na-eduzi omume ya na ọrụ ezubere iche. N'ihi na ọ bụ naanị vector prefix ka a na-amụta, ị nwere ike ịchekwa otu obere prefix maka ọrụ ọ bụla kama inwe nnomi zuru oke. Nke a na-eme ka ijere ọtụtụ ọrụ dị ọnụ ala ma na-ezere mbibi nchekwa nke nlezigharị nke ọma. Ọ na-arụ ọrụ nke ọma na ọrụ ọgbọ dị ka tebụl-na-ederede na nchịkọta, na-adabakarị nhazigharị zuru oke na ntọala data dị elu.
Nghọta nka nka
N'adịghị ka ngwa ngwa n'iji ya gee ntị, nke na-agbakwụnye naanị vectors na ntinye ntinye oyi akwa, prefix n'iji ya na-agbanye igodo azụ azụ / uru vectors n'ime nlebara anya nke oyi akwa ọ bụla. Iji mee ka ọzụzụ kwụsie ike, a na-emepụta prefix ahụ site na obere netwọk na-ebuga nri (aghugh reparameterization) kama imeziwanye ya ozugbo; A na-atụfu netwọkụ ahụ mgbe ọzụzụ gasịrị, na-ahapụ naanị matrices prefix a mụtara. Naanị ihe prefix ndị a na-enweta gradients—ọkpụkpụ azụ niile ka na-ajụ oyi.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke ntugharị prefix
Ntugharị ihe nrịbama nyeere aka ịmalite ebili mmiri na-arụ ọrụ nke ọma nke ọma (PEFT) wee bụrụ ihe mgbochi ụlọ n'ụlọ ọba akwụkwọ dị ka Hugging Face PEFT. Ka ụdị ntọala na-etolite n'ime ọtụtụ narị ijeri paramita, ihe nkwụnye ọkụ dị fechaa dị ka prefixes na-adọrọ adọrọ mmasị maka ndị na-eje ozi ọtụtụ ndị nwe ụlọ na nhazi nke ngwaọrụ. Na-atụ anya ka ụzọ ngwakọ ga-aga n'ihu na-agwakọta prefixes na mmelite ọkwa dị ala ụdị LoRA, yana iji na-eto eto na njikwa ụdị, mmadụ na omume nchekwa na-azụghachighị ụdị niile.
Mmejuputa n'ezie n'ụwa
Ịmeghari otu ọkpụkpụ azụ GPT-2 jụrụ oyi maka ọgbọ tebụl gaa na ederede site na ịzụ obere prefix na dataset WebNLG.
Na-eje ozi ọtụtụ ụdị nchịkọta ndị ahịa akọwapụtara nke ọma site na otu ụdị ekekọrịtara, nke ọ bụla dị ka faịlụ prefix nwere ike ịgbanwe.
Na-eduzi ụda ụdị asụsụ ma ọ bụ mmadụ maka chatbot na-azụghachighị ihe dị ala
Ngbanwe ngalaba data dị ala, dị ka ọgbọ ederede gbasara iwu ma ọ bụ ọgwụ, ebe nlegharị anya zuru oke ga-adaba
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prefix Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nlele Nlele Ọjụjụ Dị Mma-Tuning
Ajụjụ a na-ajụkarị
What is Prefix Tuning?
Ndozigharị ihe nrịbama bụ ụzọ na-arụ ọrụ nke ọma iji megharia ụdị asụsụ oyi kpọnwụrụ site n'ịzụ obere usoro vector na-aga n'ihu nke na-akwadodo maka ntinye oyi akwa ọ bụla. Ọ na-ahapụ gị ịhazi nnukwu ụdị maka ọrụ ọhụrụ ka ị na-emelite ihe na-erughị 1% nke paramita.
Kedu ihe ntugharị prefix na-azụ n'ezie?
Ndozi ihe nrịbama na-eme ka ọkpụkpụ azụ azụ wee mụta naanị obere usoro prefix vector na-aga n'ihu, na-eme ka ọ rụọ ọrụ nke ọma.
Ebee ka etinyere vector prefix?
Ntụgharị prefix na-akwado vectors igodo / uru nwere ike ị nweta nlebara anya nke oyi akwa ọ bụla, ọ bụghị naanị ntinye.
Kedu onye webatara ntugharị prefix na mgbe?
Xiang Lisa Li na Percy Liang tụpụtara ntụzịaka prefix na Stanford na 2021.
Kedu ihe kpatara ngbanwe prefix ji mara mma maka ịrụ ọtụtụ ọrụ?
N'ihi na naanị obere prefix bụ ọrụ akọwapụtara, ị na-echekwa otu obere faịlụ kwa ọrụ kama ịmegharị ụdị ahụ dum.
Kedu aghụghọ a na-ejikarị eme ka ọzụzụ prefix kwụsie ike?
Obere MLP na-ewepụta prefix n'oge ọzụzụ maka nkwụsi ike, wee tụfuo ya, na-ahapụ naanị matrices prefix a mụtara.