Kuringaniza byihuse
Guhita uhuza imiterere yururimi rwakonjeshejwe mukwiga urutoki rwinshi 'rwihuta rwihuta' rwerekanwe kwinjiza, aho kwandika amagambo mukiganza.
Incamake
It is one of the leanest ways to specialize a giant model, and it gets better as models get bigger.
Kwibira cyane
Kuringaniza byihuse, byatangijwe na Google abashakashatsi Lester, Al-Rfou, na Constant mu 2021, ni mubyara woroheje wo guhuza prefix. Aho gukora inyandiko yandikishijwe intoki, uhagarika moderi yose hanyuma ukiga matrike ntoya yo gushiramo ibintu - oft'soft prompts '- byateganijwe gusa kumurongo winjiza. Gradient descente ihuza iyi vectors kugirango ihuze imyitwarire iboneye kumurimo. Icyagaragaye gitangaje: nkicyitegererezo fatizo gipima ibipimo bya miliyari, guhuza byihuse bifunga icyuho hamwe no guhuza neza, amaherezo bikabihuza n'ibipimo nka SuperGLUE. Buri gikorwa gikenera gusa akantu koroheje koroheje (akenshi ibipimo ibihumbi bike), kuburyo moderi imwe yahagaritswe ishobora gukora imirimo myinshi icyarimwe. Abanditsi bakoze ibi nk '' imbaraga z 'igipimo cyo guhuza ibintu byihuse.'
Ubushishozi
Ibisobanuro byoroheje ntabwo ari amagambo nyayo-ni ibice-bireremba byubusa mu gushyiramo umwanya udakeneye guhura nikimenyetso icyo ari cyo cyose mu magambo. Bongewe gusa kumurongo winjiza (bitandukanye na prefix tuning, itera muri buri cyiciro), bigatuma guhita byoroha. Kuberako icyitegererezo cyakonjeshejwe, gradients zisubira inyuma gusa byoroshye-byihutirwa. Gutangiza, uburebure bwihuse, nubunini bwikitegererezo byose bigira ingaruka nziza kubuziranenge.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza Kuringaniza Byihuse
Kuringaniza byihuse byamamaje igitekerezo cyuko ushobora kuyobora moderi zifatizo zikonje hamwe nibimenyetso bito byize, kandi bishimangira byinshi mubikoresho bya PEFT byubu. Nka moderi ikomeza kwipimisha, ingaruka yo gufunga icyuho ituma ibintu byoroha bitabaza ibintu byinshi bihendutse. Ubushakashatsi bwagura igitekerezo cyo kwimura ibisobanuro byize kubikorwa hamwe nicyitegererezo, kubihuza no kugarura, no kubikoresha kubishobora kugenzurwa kandi bifite umutekano. Tegereza ibintu byoroshye kugirango ugumane igiciro gito gihenze hamwe na LoRA hamwe na adapt.
Gushyira mu bikorwa Isi
Guhanga icyitegererezo cya T5 cyakonjeshejwe kubikorwa byinshi bya SuperGLUE, kubika ibintu byoroshye byoroshye kuri buri gikorwa
Gukoresha bihendutse moderi imwe nini kubakiriya benshi, buriwese afite icyo yize
Kuyobora amarangamutima cyangwa imyitwarire yo gutondeka nta ntoki zikoreshwa mu buhanga
Iyimurwa ryihuse: kwitegura ikibazo kumurimo umwe wo gushyushya-gutangira kwiga kurindi
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Prompt Engineering
Ibibazo bikunze kubazwa
What is Prompt Tuning?
Guhita uhuza imiterere yururimi rwakonjeshejwe mukwiga urutoki rwinshi 'rwihuta rwihuta' rwerekanwe kwinjiza, aho kwandika amagambo mukiganza. Nimwe muburyo bworoshye bwo kwerekana imiterere nini, kandi igenda iba myiza uko moderi iba nini.
Niki 'yoroshye yihuta' mugukurikirana vuba?
Ibisobanuro byoroshye ni imyitozo ikomeza ibice byo gushyiramo umwanya, ntabwo ari amagambo asomwa n'abantu.
Ni hehe guhita byongeweho byongeramo amahugurwa?
Guhita utegura byoroheje byerekana gusa ibyinjijwe, aribyo bituma byoroha kuruta guhuza prefix.
Ni izihe ngaruka zitangaje impapuro z'umwimerere zagaragaje ku gipimo cy'icyitegererezo?
Umutwe wuru rupapuro washimangiye 'imbaraga zipima': moderi nini reka reka guhita uhuza mukeba neza neza.
Ninde watangije guhita?
Brian Lester, Rami Al-Rfou, na Noah Constant kuri Google basohoye impapuro zo guhita zandika mu 2021.
Nigute guhita ushyira mubikorwa gukora imirimo myinshi uhereye kumurongo umwe?
Gusa akantu koroheje koroheje nigikorwa cyihariye, kuburyo moderi imwe yahagaritswe irashobora kwakira imirimo myinshi muguhindura ibisobanuro.