Guhuza imbanzirizamushinga
Kuringaniza ibanzirizasuzuma nuburyo bukoreshwa muburyo bwo guhuza imiterere yururimi rwakonjeshejwe mugutoza urutonde ruto rwikurikiranya rugenda rwerekanwa kuri buri cyiciro cyinjijwe.
Incamake
It lets you customize giant models for new tasks while updating less than 1% of parameters.
Kwibira cyane
Prefix tuning, yatangijwe nabashakashatsi ba Stanford Li na Liang mu 2021, ihuza transformateur yabigenewe idakora ku buremere bwayo. Aho kugirango uhuze neza ibipimo byose, itegura urukurikirane rwamahugurwa 'yerekana ibimenyetso' (prefix) kumfunguzo nindangagaciro kuri buri cyerekezo. Moderi yahagaritswe yitabira iyi prefix nkaho ari imiterere nyayo, ikayobora imyitwarire yayo kugikorwa runaka. Kuberako ibice byambere byonyine byize, urashobora kubika agace gato kambere kuri buri mwanya aho kuba kopi yuzuye yicyitegererezo. Ibi bituma gukora imirimo myinshi bihendutse kandi birinda guhunika ububiko bwuzuye neza. Ikora cyane cyane kumurimo wibisekuruza nkimbonerahamwe-ku-mwandiko hamwe nincamake, akenshi bihuza neza-neza neza-murwego rwo hejuru.
Ubushishozi
Bitandukanye no guhita uhuza, wongeyeho gusa ibice byinjiza byinjizwamo, prefix tuning itera urufunguzo ruto / agaciro indangagaciro muri buri gihinduramatwara cyo kwiyitaho. Kugirango uhagarike imyitozo, imbanzirizamushinga isanzwe itangwa numuyoboro muto ugaburira imbere (amayeri yo gusubiramo) aho kuba muburyo butaziguye; urwo rusobe rujugunywa nyuma yimyitozo, hasigara gusa matrice yize. Gusa ibipimo byibanze byakira gradients-umugongo wose uguma uhagaritse.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Prefix Guhuza
Kuringaniza prefix byafashije gutangiza ibipimo-byiza-neza neza (PEFT) kandi bikomeza kuba inyubako mumasomero nka Hugging Face PEFT. Mugihe icyitegererezo fatizo gikura mumajana ya miliyari yibipimo, adaptate zoroheje nka prefixes ziragenda zishimisha kubantu benshi bakodesha no kugiti cyabo. Tegereza uburyo bukomatanyije buvanga imbanzirizamushinga hamwe na LoRA-yuburyo bwo hasi-ivugururwa, hamwe no gukoreshwa muburyo bwo kugenzura imiterere, abantu, n imyitwarire yumutekano utarinze kwitoza moderi zose.
Gushyira mu bikorwa Isi
Guhuza umugongo umwe wa GPT-2 wahagaritswe kumeza kumyandiko-mwandiko mugutoza prefix ntoya kuri dataset ya WebNLG
Gukora ibyicaro byabakiriya-byihariye byerekana incamake kuva muburyo bumwe busangiwe, buri kimwe nka fayili yimbere
Kuyobora imvugo yindimi imvugo cyangwa umuntu kuri chatbot utarinze kongera imyitozo yibanze
Kurwanya amakuru make-yo guhuza n'imihindagurikire y'ikirere, nk'amategeko cyangwa ubuvuzi bwanditse, aho byuzuye neza
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prefix Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwangwa Gutoranya Cyiza-Guhuza
Ibibazo bikunze kubazwa
What is Prefix Tuning?
Kuringaniza ibanzirizasuzuma nuburyo bukoreshwa muburyo bwo guhuza imiterere yururimi rwakonjeshejwe mugutoza urutonde ruto rwikurikiranya rugenda rwerekanwa kuri buri cyiciro cyinjijwe. Iragufasha guhitamo moderi nini kubikorwa bishya mugihe uvugurura munsi ya 1% yibipimo.
Kuringaniza prefix mubyukuri bitoza iki?
Kuringaniza ibanzirizasuzuma bikonjesha umugongo kandi biga gusa agace gato ko gukomeza prefix vectors, kugumya gukora neza.
Nihehe prefix vectors yatewe?
Kuringaniza ibanziriza itegura urufunguzo ruto / agaciro indangagaciro kuri buri transformateur urwego rwo kwiyitaho, ntabwo ari ibyinjijwe gusa.
Ninde watangije prefix tuning kandi hafi iyo?
Guhitamo prefix byasabwe na Xiang Lisa Li na Percy Liang i Stanford mu 2021.
Ni ukubera iki guhuza prefix gushimisha gukora imirimo myinshi?
Kuberako gusa prefix ntoya ni umurimo-wihariye, ubika dosiye ntoya kuri buri gikorwa aho kwigana icyitegererezo cyose.
Ni ubuhe buryo bukoreshwa kenshi muguhagarika imyitozo ya prefix?
Gitoya MLP itanga prefix mugihe cyamahugurwa yo gutuza, hanyuma ikajugunywa kure, hasigara gusa matricike yize.