Gyaran gaggawa
Gyaran gaggawa yana daidaita ƙirar yare daskararre ta hanyar koyan ɗimbin ci-gaban 'laushi mai laushi' da aka riga aka shirya don shigarwa, maimakon rubuta kalmomi da hannu.
Dubawa
It is one of the leanest ways to specialize a giant model, and it gets better as models get bigger.
Zurfafa nutsewa
Sauƙaƙen gaggawa, wanda Google masu bincike Lester, Al-Rfou, da Constant suka gabatar a cikin 2021, shine mafi sauƙin ƙani na kunna prefix. Maimakon ƙirƙirar saƙon rubutu da hannu, kuna daskare gabaɗayan ƙirar kuma ku koyi ƙaramin matrix na ci gaba da sakawa-'mai taushin tsokaci'—wanda aka riga aka tsara shi kawai a layin shigarwa. Saukawar ƙasa tana ƙara wa ɗ annan sifofi don korar dacewar hali don ɗawainiya. Bincike mai ban sha'awa: yayin da ƙirar tushe ke yin ma'auni zuwa biliyoyin sigogi, saurin daidaitawa yana rufe ratar tare da cikakken daidaitawa, a ƙarshe yana daidaita shi akan maƙasudai kamar SuperGLUE. Kowane ɗawainiya yana buƙatar ɗan ƙaramin saƙon saƙon sa kawai (sau da yawa ƴan sigogi dubu), don haka ƙirar daskararre guda ɗaya na iya yin ayyuka da yawa a lokaci ɗaya. Marubutan sun tsara wannan a matsayin 'ƙarfin ma'auni don daidaita saurin daidaita ma'auni.'
Fahimtar Fasaha
Tausayi mai laushi ba kalmomi ne na gaske ba—sune masu yawo a cikin sararin samaniya waɗanda basu buƙatar dacewa da kowace alama a cikin ƙamus. Ana ƙara su ne kawai a layin shigar da bayanai (sabanin prefix tuning, wanda ke allura cikin kowane Layer), yana sa saurin daidaitawa ya fi sauƙi. Saboda samfurin ya daskare, gradients suna komawa baya kawai zuwa abubuwan da aka haɗa da sauri. Ƙaddamarwa, tsayin gaggawa, da sikelin ƙirar duk suna tasiri mai ƙarfi sosai.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Gyara Sauƙaƙe
Sauƙaƙewar gaggawa ta ba da ra'ayin cewa za ku iya sarrafa ƙirar tushe mai daskararre tare da ƙananan sigina na koyo, kuma yana ƙarfafa yawancin kayan aikin PEFT na yau. Kamar yadda samfura ke ci gaba da ƙima, tasirin rufe giɓin yana sa tsokaci mai laushi ya burge don ƙaddamar da ayyuka masu arha. Bincike yana ƙaddamar da ra'ayin don canja wurin abubuwan koyo a cikin ayyuka da ƙira, haɗa su tare da maidowa, da amfani da su don tsarawa da aminci. Yi tsammanin saƙo mai laushi ya kasance mai rahusa mai rahusa tare da LoRA da adaftan.
Aiwatar da Gaskiyar Duniya
Ƙware ƙirar T5 mai daskararre guda ɗaya don ayyuka na SuperGLUE da yawa, tana adana keɓantaccen mai taushi ga kowane ɗawainiya
A rahusa tura babban samfuri guda ɗaya a kan abokan ciniki da yawa, kowannensu yana da abin da ya koya
Hannun jagoranci ko halin rarrabuwa ba tare da kalmomin aikin injiniya da hannu ba
Canja wuri mai laushi mai laushi: fara horar da gaggawa kan ɗawainiya ɗaya don fara koyo akan wani abu mai alaƙa
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Prompt Engineering
Tambayoyin da ake yawan yi
What is Prompt Tuning?
Gyaran gaggawa yana daidaita ƙirar yare daskararre ta hanyar koyan ɗimbin ci-gaban 'laushi mai laushi' da aka riga aka shirya don shigarwa, maimakon rubuta kalmomi da hannu. Yana ɗaya daga cikin mafi ƙarancin hanyoyin ƙware don ƙwararrun ƙirar ƙira, kuma yana samun mafi kyau yayin da samfuran ke girma.
Menene 'mai laushi mai laushi' a cikin saurin kunnawa?
Taushi mai laushi shine ci gaba da horarwa a cikin haɗa sararin samaniya, ba kalmomi masu iya karantawa ba.
A ina saurin kunnawa yana ƙara ma'auni mai iya horarwa?
Gyaran gaggawa yana tsara tausasawa kawai a shigarwar, wanda shine abin da ya sa ya fi sauƙi fiye da kunna prefix.
Wane tasiri mai ban mamaki ne ainihin takardar ta haskaka game da sikelin samfurin?
Taken takardar ya jaddada 'ikon sikelin': manyan samfura suna ba da damar kunna kishiya da cikakken daidaitawa.
Wanene ya gabatar da saurin kunnawa?
Brian Lester, Rami Al-Rfou, da Nuhu Constant a Google sun buga takarda mai sauri a cikin 2021.
Ta yaya saurin kunnawa ke ba da damar yin ayyuka da yawa daga samfuri ɗaya?
Ƙaramin ƙaramar faɗakarwa ce ta ƙayyadaddun ɗawainiya, don haka samfurin daskararre ɗaya zai iya ɗaukar ayyuka da yawa ta hanyar musanya tsokaci.