Horgalayaasha Tuning
Hagaajinta horgalayaasha waa hab wax ku ool ah oo lagu waafajiyo qaabka luqadda la qaboojiyey iyadoo la tababarayo qayb yar oo ka mid ah vectors joogto ah kuwaas oo loo sii diyaariyay wax gelinta lakab kasta.
Dulmar
It lets you customize giant models for new tasks while updating less than 1% of parameters.
quusid qoto dheer
Hagaajinta horgalayaasha, oo ay soo bandhigeen cilmi-baarayaasha Stanford Li iyo Liang sanadka 2021, waxa ay la qabsadaan beddelka horay loo tababaray isaga oo aan taaban miisaankiisa. Halkii ay si fiican u hagaajin lahayd dhammaan xuduudaha, waxay u sii diyaarisaa isku xigxiga 'calaamadaha dhabta ah' (horgagga) furayaasha iyo qiyamka lakab kasta oo feejignaan ah. Qaabka la qaboojiyey wuxuu u dhigaa horgalayaashan sidii inuu yahay macnaha dhabta ah, isaga oo u jihaynaya dhaqankiisa hawl la beegsanayo. Sababtoo ah kaliya vectors horgalaha ayaa la bartay, waxaad kaydin kartaa hal horgalayaal yar oo hawl kasta ah halkii aad ka heli lahayd nuqul buuxa. Tani waxay ka dhigaysa u adeegida hawlo badan mid raqiis ah waxayna ka fogaanaysaa bakhaarka kaydinta ee hagaajinta buuxda. Waxay si gaar ah u qabataa hawlaha jiilka sida miis-ka-qoraal iyo soo koobid, inta badan waxay ku habboon tahay hagaajinta buuxda ee goobaha xogta sare.
Aragtida Farsamada
Si ka duwan hagaajinta degdega ah, kaas oo kaliya ku dara vectors lakabka wax gelinta, hagaajinta horgalayaasha waxay duraysaa hufayaasha furaha/qiimaha tababbaran ee lakab kasta oo is beddelka ah. Si loo xasiliyo tababbarka, horgalayaasha waxaa sida caadiga ah soo saara shabakad quudin-horumarineed oo yar (khiyaano dib-u-eegis ah) halkii si toos ah loo hagaajin lahaa; Shabakaddaas waa la tuuray tababarka ka dib, taasoo ka tagaysa kaliya jaangooyooyinkii horgalayaasha la bartay. Kaliya halbeegyadan horgalayaasha ah ayaa hela gradients-dhammaan laf dhabarta way barafoobaysaa.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Horgalayaasha Tuning
Hagaajinta horgalayaasha waxay gacan ka gaysatay soo saarista mawjadda-habaynta-wanaagga-wax-ku-oolnimada leh (PEFT) waxayna weli tahay dhismaha dhismaha maktabadaha sida Hugging Face PEFT. Sida moodooyinka salku u koraan boqollaal balaayiin cabirro ah, adabiyeyaasha fudud sida horgalayaasha ayaa si isa soo taraysa u soo jiidanaya adeega kiraystayaasha badan iyo shaqsiyaynta qalabka. Filo habab isku-dhafan oo sii socda oo isku dara horgaleyaal cusub oo qaabka LoRA ah, iyo isticmaalka sii kordhaya ee xakamaynta qaabka, qofnimada, iyo habdhaqanka badbaadada iyada oo aan dib loo tababarin moodooyinka oo dhan.
Dhaqangelinta Adduunka-dhabta ah
La qabsiga hal laf dhabarta barafsan ee GPT-2 jiilka miiska-qoraalka iyadoo la tababarayo horgale yar oo ku saabsan xogta WebNLG
U adeega daraasiin hab-koobeedka gaarka ah ee macmiilka laga soo bilaabo hal nooc oo la wadaago, mid walbana sidii fayl horgale ah oo la beddeli karo
U hagida qaabka luqadda codkiisa ama qof ahaaneed ee chatbot adoon dib u tababarin miisaanka salka
Laqabsiga xog-hooseeya, sida jiilka qoraalka sharciga ama caafimaadka, halkaasoo hagaajinta buuxda ay ku habboon tahay
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prefix Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Diidmada Muunad-qaadista Fine-Tuning
Su'aalaha soo noqnoqda
What is Prefix Tuning?
Hagaajinta horgalayaasha waa hab wax ku ool ah oo lagu waafajiyo qaabka luqadda la qaboojiyey iyadoo la tababarayo qayb yar oo ka mid ah vectors joogto ah kuwaas oo loo sii diyaariyay wax gelinta lakab kasta. Waxay kuu ogolaanaysaa inaad u habayso moodooyinka waaweyn ee hawlo cusub iyadoo la cusboonaysiinayo wax ka yar 1% cabirrada.
Maxay dhab ahaantii tabobaraysaa hagaajinta horgalayaasha?
Hagaajinta horgalayaasha waxay qaboojisaa laf dhabarta oo waxay barataa kaliya tiro yar oo horgaleyaal joogto ah, taasoo ka dhigaysa mid hufan.
Halkee lagu duray horgalayaasha horgalayaasha?
Hagaajinta horgalayaasha waxay udiyaarisaa hufayaasha furaha la tababari karo/qiimaha leh ee lakab kasta oo wax beddelka ah ee is-fiirinta, ma aha oo kaliya talinta.
Yaa soo bandhigay hagaajinta horgalayaasha iyo qiyaas ahaan goorma?
Hagaajinta horgalayaasha waxaa soo jeediyay Xiang Lisa Li iyo Percy Liang ee Stanford sanadka 2021.
Waa maxay sababta hagaajinta horgalayaasha u soo jiidasho leh u adeegida hawlo badan?
Sababtoo ah kaliya horgalayaasha yar waa hawl gaar ah, waxaad kaydisaa hal fayl oo yar hawl kasta halkii aad nuqul ka samayn lahayd qaabka oo dhan.
Waa maxay khiyaamo inta badan loo isticmaalo in lagu dejiyo tababbarka horgalayaasha?
MLP yar ayaa soo saarta horgalaha inta lagu jiro tababarka xasilloonida, ka dibna waa la tuurayaa, isaga oo ka tagaya kaliya jaangooyooyinkii horgalaha ee la bartay.