Tuning Prefix
Gyaran prefix hanya ce mai inganci don daidaita ƙirar yare daskararre ta hanyar horar da ƙaramin saiti na ci gaba da haɓakawa waɗanda aka riga aka tsara don shigar da kowane Layer.
Dubawa
It lets you customize giant models for new tasks while updating less than 1% of parameters.
Zurfafa nutsewa
Gyaran prefix, wanda masu bincike na Stanford Li da Liang suka gabatar a cikin 2021, yana daidaita injin da aka riga aka horar ba tare da taɓa nauyinsa ba. Maimakon daidaita dukkan sigogi, yana tsara jerin jerin 'alamu na gani' (fasali) zuwa maɓalli da ƙima a kowane matakin kulawa. Samfurin daskararre yana halartar wannan prefix kamar dai mahallin gaske ne, yana jagorantar halayensa zuwa wani aiki da aka yi niyya. Domin kawai prefix vectors ana koya, za ka iya adana ƙaramin prefix ɗaya a kowane ɗawainiya maimakon cikakken kwafin samfuri. Wannan yana sa hidimar ayyuka da yawa arha kuma yana guje wa ɓarnar ajiya na cikakken daidaitawa. Yana aiki da kyau musamman akan ayyukan tsarawa kamar tebur-zuwa-rubutu da taƙaitawa, sau da yawa daidai da cikakkiyar daidaitawa a cikin manyan saitunan bayanai.
Fahimtar Fasaha
Ba kamar saurin kunnawa ba, wanda kawai ke ƙara vectors a Layer na shigar da bayanai, prefix tuning yana shigar da maɓalli/ƙimar maɓalli masu iya horarwa cikin kowane mai canza canjin kai. Don daidaita horo, ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙayyadaddun tsarin shine ke samar da shi ta hanyar ƙaramin hanyar sadarwa mai ciyarwa (waɗanda za a gyara su) maimakon inganta su kai tsaye; Ana watsar da wannan hanyar sadarwar bayan horo, barin kawai matrix prefix da aka koya. Waɗannan sigogin prefix kawai suna karɓar gradients-dukkan kashin baya yana tsayawa a daskare.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Tuning Prefix
Gyaran prefix ya taimaka ƙaddamar da kalaman daidaita-daidaitacce (PEFT) kuma ya kasance tubalin gini a cikin ɗakunan karatu kamar Hugging Face PEFT. Yayin da ƙirar tushe ke girma zuwa ɗaruruwan biliyoyin sigogi, adaftan masu nauyi kamar prefixes suna ƙara sha'awa don hidimar masu haya da yawa da keɓance kan na'ura. Yi tsammanin ci gaba da hanyoyin haɗaɗɗun hanyoyin da ke haɗa prefixes tare da sabuntawar ƙarancin salon salon LoRA, da haɓaka amfani wajen sarrafa salo, mutum, da halayen aminci ba tare da sake horar da samfuran gabaɗayan ba.
Aiwatar da Gaskiyar Duniya
Daidaita kashin baya GPT-2 daya daskararre don tsara tsararrun rubutu zuwa rubutu ta hanyar horar da ƙaramin prefix akan saitin bayanan WebNLG
Hidima da yawa na takamaiman salon taƙaitaccen abokin ciniki daga samfuri ɗaya da aka raba, kowanne a matsayin fayil ɗin prefix mai musanya
Gudanar da sautin samfurin harshe ko mutum don chatbot ba tare da sake horar da ma'aunin tushe ba
Karɓar yanki mai ƙarancin bayanai, kamar tsararrun rubutu na doka ko na likita, inda cikakken daidaitawa zai wuce gona da iri
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prefix Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ƙimar Samfura Mai Kyau-Tuning
Tambayoyin da ake yawan yi
What is Prefix Tuning?
Gyaran prefix hanya ce mai inganci don daidaita ƙirar yare daskararre ta hanyar horar da ƙaramin saiti na ci gaba da haɓakawa waɗanda aka riga aka tsara don shigar da kowane Layer. Yana ba ku damar keɓance manyan samfura don sabbin ayyuka yayin haɓaka ƙasa da 1% na sigogi.
Menene ainihin tuning prefix yake horarwa?
Gyaran prefix yana daskare kashin baya kuma yana koyan ƙaramin saiti na ci gaba da fayyace prefix, yana kiyaye shi mai inganci.
Ina ake allurar prefix vector?
Gyaran prefix yana tanadar maɓalli/ƙimar maɓalli mai iya horarwa a kowane nau'in taswirar kai tsaye, ba kawai shigarwar ba.
Wanene ya gabatar da kunna prefix kuma kusan yaushe?
Xiang Lisa Li da Percy Liang ne suka gabatar da shirin gyara prefix a Stanford a cikin 2021.
Me yasa kunna prefix ke da kyau don hidimar ayyuka da yawa?
Domin kawai ƙaramin prefix ɗin yana da takamaiman ɗawainiya, kuna adana ƙaramin fayil ɗaya akan kowane ɗawainiya maimakon kwafi gabaɗayan ƙirar.
Wace dabara ake yawan amfani da ita don daidaita horon prefix?
Karamin MLP yana haifar da prefix yayin horo don kwanciyar hankali, sannan a jefar dashi, yana barin matrix prefix kawai.