Adaftar Layers don Canja wuri
Adaftan yadudduka ƙananan na'urori ne masu horarwa waɗanda aka saka a cikin ƙirar da aka riga aka yi daskararre, suna ba ku damar daidaita shi zuwa sabbin ɗawainiya ta hanyar ɗaukaka kaɗan kawai na sigogi.
Dubawa
They make fine-tuning cheap, modular, and easy to swap.
Zurfafa nutsewa
Adafta, wanda Houlsby et al ya shahara. (2019) don canja wurin koyo a cikin NLP, magance matsala mai tsada: cikakken daidaitawa mai kyau yana sabunta kowane nauyi a cikin babban samfuri kuma yana samar da sabon kwafin kowane ɗawainiya. Adafta a maimakon haka yana shigar da ƙananan hanyoyin sadarwa na kwalabe a cikin kowane toshewar taswira, yawanci aikin ƙasa zuwa ƙananan girma, rashin daidaituwa, da kuma aikin baya, nannade cikin haɗin da ya rage. Yayin horo ainihin ma'aunin nauyi da aka riga aka horar ya kasance daskararre; kawai adaftan (sau da yawa a ƙarƙashin 5% na jimlar sigogi) ana koya. Wannan yana samar da ingantacciyar daidaitawa ta kusa-cikakken-kyau akan ma'auni kamar GLUE yayin horar da ma'auni kaɗan. Domin kowane ɗawainiya yana samun ƙaramin adaftar nasa, zaku iya adana ƙirar tushe guda ɗaya tare da na'urori masu nauyi masu nauyi masu yawa, kuma musanya ko ma tara su. Adafta su ne memba na asali na dangi mai inganci mai inganci (PEFT), tare da LoRA da kunna prefix.
Fahimtar Fasaha
Adaftar kwalabe na al'ada yana aiwatar da yanayin ɓoyayyiyar d-dimensional ɗin ƙasa zuwa ƙarami mai girma m, yana aiki da rashin kan layi, sannan ayyukan baya har zuwa d, tare da haɗin tsallakewa don haka yana farawa kusa da ainihi. Tare da m mafi ƙanƙanta da d, abubuwan da aka ƙara sun kasance kanana. Saboda ƙirar tushe tana daskarewa, gradients kawai suna gudana ta ma'aunin adaftar, yana yanke ƙwaƙwalwar ingantawa. Babban farashin lokacin aiki shine ƙaramin ƙarar latency kowane Layer, wanda ke gabatowa kamar rage LoRA ta hanyar haɗa ma'aunin koyo baya cikin ma'aunin tushe.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Adaftar Layers don Canja wuri
Adafta da faffadan kayan aikin PEFT yanzu sun zama madaidaitan don keɓance manyan samfura cikin araha, musamman a matsayin balloon masu girma dabam. Yi tsammanin haɓakawa a cikin abubuwan adaftar (haɗa ɗawainiya ko masu adaftar harshe na zamani, kamar yadda yake cikin AdapterHub), kewayawa tsakanin adaftan da yawa a ra'ayi, da keɓance kan na'ura inda ƙaramin adaftan ke ɗinkin ƙirar tushe mai raba ga kowane mai amfani. Bambance-bambancen LoRA suna ƙara mamayewa don ingantaccen aiki, amma ainihin ra'ayin, daskare babban ƙirar da horar da ƙaramin fashe, yanzu shine tsakiyar yadda filin sikelin keɓancewa.
Aiwatar da Gaskiyar Duniya
Ƙara adaftar takamaiman harshe ta yadda za a iya keɓance samfurin yaruka da yawa don, a ce, Swahili ba tare da sake horar da duk hanyar sadarwa ba.
Tsayar da samfurin tushe guda ɗaya da ɗimbin ƙananan adaftar kowane abokin ciniki a cikin samfurin SaaS, musanya wanda ya dace a kowace buƙata.
Kyakkyawan daidaita samfurin don rarrabuwar ra'ayi ta hanyar horar da adaftan kashi kaɗan kawai, sannan adana tushe don wasu ayyuka.
Adana adaftar ɗawainiya a saman adaftar yanki (misali, adaftan rubutu na doka da adaftar taƙaitawa) don sake amfani da na'urar.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Adapter Layers for Transfer quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
T5 da Canja wurin Rubutu zuwa Rubutu
Tambayoyin da ake yawan yi
What is Adapter Layers for Transfer?
Adaftan yadudduka ƙananan na'urori ne masu horarwa waɗanda aka saka a cikin ƙirar da aka riga aka yi daskararre, suna ba ku damar daidaita shi zuwa sabbin ɗawainiya ta hanyar ɗaukaka kaɗan kawai na sigogi. Suna yin arha, daidaitawa, da sauƙin musanya.
Menene ya faru da ainihin ma'aunin da aka riga aka horar yayin horo tare da adaftan?
Gyaran adaftan yana sa ƙirar tushe ta daskare kuma tana koyon ƙananan kayan aikin da aka saka kawai.
Menene ainihin tsarin ciki na adaftar wuyan kwalba?
Adaftan al'ada yana matse yanayin ɓoye zuwa ƙaramin girma, yana aiwatar da rashin kan layi, aiwatar da baya, kuma yana ƙara haɗin tsallakewa.
Kusan wane juzu'i na sigogin adaftan suke horarwa?
Adafta yawanci suna ƙara da horar da ƴan kashi 100 na jimillar sigogin ƙirar, ƙasa da cikakken daidaitawa.
Me yasa adaftan ya dace don yin ayyuka da yawa?
Saboda kowane ɗawainiya kawai yana buƙatar ƙaramin adafta, ƙirar tushe ɗaya ɗaya na iya yin ayyuka da yawa ta hanyar musanya na'urori masu nauyi.
Ga wanne dangin dabaru ne masu adaftar ke kasancewa?
Adafta ita ce ainihin hanyar PEFT, tare da hanyoyin kamar LoRA da tuning prefix.