Ntugharị ngwa ngwa
Ndozi ngwa ngwa na-emegharị ụdị asụsụ oyi kpọnwụrụ site n'ịmụta ntakịrị 'dị nro ngwa ngwa' vectors na-aga n'ihu na ntinye, kama iji aka dee okwu.
Nchịkọta
It is one of the leanest ways to specialize a giant model, and it gets better as models get bigger.
Ime miri emi
Ndozi ngwa ngwa, nke Google ndị nyocha Lester, Al-Rfou, na Constant webatara na 2021, bụ nwanne nwanne kacha mfe maka ntugharị prefix. Kama iji aka rụọ ngwa ngwa ederede, ị na-atụba ụdị ahụ dum wee mụta obere matriks nke ntinye na-aga n'ihu - 'mkpụrụ obi dị nro' - nke emebere naanị na oyi akwa ntinye. Mmụda gradient na-akụ vector ndị a ka ha na-akpa àgwà ziri ezi maka otu ọrụ. Nchọpụta dị ịrịba ama: ka ihe nlereanya ntọala na-erute ọtụtụ ijeri paramita, nlegharị anya ngwa ngwa na-emechi oghere ahụ site na ngbanwe zuru oke, na-emecha dakọọ ya na akara ngosi dịka SuperGLUE. Ọrụ ọ bụla chọrọ naanị obere nro dị nro nke ya (mgbe ọ na-abụkarị puku paramita ole na ole), yabụ otu ụdị oyi kpọnwụrụ nwere ike ịrụ ọtụtụ ọrụ n'otu oge. Ndị odee debere nke a dị ka 'ikike nke ọnụ ọgụgụ maka nlegharị anya ngwa ngwa na-arụ ọrụ nke ọma.'
Nghọta nka nka
Mkpali dị nro abụghị okwu n'ezie - ha bụ vector na-ese n'efu na ntinye oghere nke na-ekwesịghị ikwekọrịta na akara ọ bụla n'ime okwu. A na-agbakwunye ha naanị na oyi akwa ntinye ntinye (n'adịghị ka nhazi prefix, nke na-abanye n'ime oyi akwa ọ bụla), na-eme ka nlegharị anya ngwa ngwa ọbụna dị ọkụ. N'ihi na ihe nlereanya ahụ kpọnwụrụ akpọnwụ, gradients na-alaghachi azụ naanị na ntinye ngwa ngwa ngwa ngwa. Mmalite, ogologo ọsọ ọsọ, na ọnụ ọgụgụ ihe nlereanya niile na-emetụta ịdịmma.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke ntugharị ngwa ngwa
Ntugharị ngwa ngwa mere ka echiche ahụ pụta ìhè na ị nwere ike iji obere akara mmụta na-eduzi ụdị ntọala kpọnwụrụ akpọnwụ, ọ na-akwadokwa ọtụtụ ngwa ngwa PEFT taa. Dị ka ụdị na-aga n'ihu na-arị elu, mmetụta mmechi nke oghere na-eme ka ọ dị nro na-adọrọ mmasị maka ibuga ọtụtụ ọrụ dị ọnụ ala. Nchọpụta na-agbasa echiche iji nyefee mkpali mmụta a na-amụta n'ofe ọrụ na ụdị, jikọta ha na iweghachite, ma jiri ha maka ọgbọ nwere ike ịchịkwa yana nchekwa. Na-atụ anya mkpali dị nro ka ọ bụrụ onye na-azụ ahịa dị ọnụ ala n'akụkụ LoRA na ihe nkwụnye ọkụ.
Mmejuputa n'ezie n'ụwa
Ọpụrụiche otu ụdị T5 jụrụ oyi maka ọtụtụ ọrụ SuperGLUE, na-echekwa ngwa ngwa dị nro dị iche n'otu ọrụ
Na-adị ọnụ ala na-ebuga otu nnukwu ụdị n'ofe ọtụtụ ndị ahịa, onye ọ bụla nwere ngwa mmụta ha mụtara
Mmetụta nchịkwa ma ọ bụ omume nhazi ọkwa na-enweghị mkpụrụ okwu injinia
Nyefe ngwa ngwa: ịmalite ọzụzụ ngwa ngwa n'otu ọrụ iji malite ịmụrụ ihe na nke metụtara ya
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Prompt Engineering
Ajụjụ a na-ajụkarị
What is Prompt Tuning?
Ntugharị ngwa ngwa na-emegharị ụdị asụsụ oyi kpọnwụrụ site n'ịmụta ntakịrị 'dị nro ngwa ngwa' vectors na-aga n'ihu na ntinye, kama iji aka dee okwu. Ọ bụ otu n'ime ụzọ kachasị dị nro iji mara nnukwu ihe nlereanya, ọ na-akawanye mma ka ụdị na-ebuwanye ibu.
Kedu ihe bụ 'ngwa ngwa ngwa ngwa' na ngbanwe ngwa ngwa?
Mkpali dị nro bụ vector na-aga n'ihu na-enye ọzụzụ na-etinye ohere, ọ bụghị okwu mmadụ nwere ike ịgụ.
Ebee ka nlegharị anya ngwa ngwa na-agbakwunye vector ya nwere ike inye ọzụzụ?
Ndozi ngwa ngwa na-akwado mkpali dị nro naanị na ntinye, nke bụ ihe na-eme ka ọ dị mfe karịa nlegharị anya prefix.
Mmetụta dị aṅaa na-atụ n'anya ka akwụkwọ akụkọ mbụ ahụ pụta ìhè banyere ọnụ ọgụgụ ihe nlereanya?
Aha akwụkwọ akụkọ ahụ kwusiri ike na 'ikike nke ọnụ ọgụgụ': ụdị ndị buru ibu na-ahapụ ngwa ngwa n'iji ya gee onye na-agba ọsọ n'ụzọ zuru oke.
Kedu onye webatara nhazi ngwa ngwa?
Brian Lester, Rami Al-Rfou, na Noah Constant na Google bipụtara akwụkwọ nlegharị anya ngwa ngwa na 2021.
Kedu ka nlegharị anya ngwa ngwa si enyere ọtụtụ ọrụ aka site na otu ụdị?
Naanị obere ngwa ngwa dị nro bụ ọrụ akọwapụtara, yabụ otu ụdị oyi kpọnwụrụ nwere ike ịnabata ọtụtụ ọrụ site na ịgbanwee mkpali.