Daawaynta degdega ah
Hagaajinta degdega ah waxay habaysaa qaabka luqadda la qaboojiyey iyadoo baranaysa in yar oo 'dagdag jilicsan' oo joogto ah oo loo sii diyaariyay gelinta, halkii aad erayada gacanta ku qori lahayd.
Dulmar
It is one of the leanest ways to specialize a giant model, and it gets better as models get bigger.
quusid qoto dheer
Daawaynta degdega ah, oo ay soo bandhigeen Google cilmi-baarayaasha Lester, Al-Rfou, iyo Constant sanadka 2021, waa ina adeerka ugu fudud ee hagaajinta horgalayaasha. Halkii aad gacanta ku samayn lahayd isla markiiba qoraalka, waxaad qaboojisaa moodalka oo dhan oo aad barataa shax yar oo ku-xidhnaanshaha joogtada ah-'jilicsanaan'-taasoo lagu sii diyaariyay kaliya lakabka wax gelinta. Dheecaan si tartiib tartiib ah u soo degitaannadan si ay u habeeyaan dhaqanka saxda ah ee hawsha. Natiijo cajiib ah: marka qaabka salku uu u miisaamo balaayiin halbeegyo ah, hagaajinta degdega ah waxay ku xidhaysaa farqiga iyadoo si buuxda u hagaajinaysa, ugu dambayntiina waxay ku habboon tahay bartilmaameedyada sida SuperGLUE. Hawl kastaa waxay u baahan tahay oo keliya degdeg yar oo jilicsan (badanaa dhawr kun oo cabbir), markaa hal nooc oo la qaboojiyey ayaa hal mar u adeegi kara hawlo badan. Qorayaashu waxay tani u qaabeeyeen sidii 'awoodda miisaanka ee hagaajinta degdegga ah ee wax-ku-oolka ah.'
Aragtida Farsamada
Dareen-celinta jilicsan maaha ereyo dhab ah - waa falayaal sabbaynaya xorta ah oo ku dhexjira meel bannaan oo aan u baahnayn calaamad kasta oo ku jirta ereyada. Waxa lagu daraa kaliya lakabka wax gelinta (ka duwan hagaajinta horgalayaasha, kaas oo duraya lakab kasta), taasoo ka dhigaysa hagaajin degdeg ah xitaa mid fudud. Sababtoo ah moodelku waa barafoobay, gradients-ku waxay dib ugu soo noqonayaan kaliya kuwa jilicsan ee degdegga ah. Bilawga, dhererka degdega ah, iyo miisaanka moodeelka ayaa dhamaantood si xoog leh u saameeya tayada.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Toosinta Degdegga ah
Hagaajinta degdega ah waxay faafisay fikradda ah inaad ku hagi karto moodooyinka aasaasiga ah ee la qaboojiyey oo wata calaamado yaryar oo la bartay, waxayna taageertaa inta badan qalabka PEFT ee maanta. Sida moodellada ay kor u qaadayaan, saamaynta xidhitaanka farqiga ayaa ka dhigaysa dareenno jilicsan oo soo jiidanaya hawlo badan oo raqiis ah. Cilmi-baadhistu waxay fidinaysaa fikradda lagu wareejinayo dardar-gelinta la baran karo ee hawlaha iyo moodooyinka, lagu daro dib-u-soo-celinta, oo loo isticmaalo jiil la kontarooli karo oo ammaan ah. Filo in dariiqooyinka jilicsan ay ku sii ahaadaan kabaal qiimo jaban oo ay weheliyaan LoRA iyo adaabiyeyaasha.
Dhaqangelinta Adduunka-dhabta ah
Ku takhasusay hal moodal T5 barafaysan oo loogu talagalay hawlo badan oo SuperGLUE ah, kaydinta degdeg jilicsan oo gooni ah hawl kasta
Si raqiis ah u daad-gureynaya hal nooc oo weyn oo dhan macaamiil badan, mid walbana leh degdeg uu bartay
Dareen hagida ama habdhaqan kala soocida iyada oo aan gacanta lagu qorin kelmad injineernimo
Wareejinta degdega ah: u diyaarinta degdega ah hal hawl si diirran loogu bilaabo barashada mid la xidhiidha
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Prompt Engineering
Su'aalaha soo noqnoqda
What is Prompt Tuning?
Hagaajinta degdega ah waxay habaysaa qaabka luqadda la qaboojiyey iyadoo baranaysa in yar oo 'dagdag jilicsan' oo joogto ah oo loo sii diyaariyay gelinta, halkii aad erayada gacanta ku qori lahayd. Waa mid ka mid ah siyaabaha ugu caatada ah ee lagu takhasuso moodeel weyn, wayna ka sii fiicnaanaysaa marka moodooyinka ay sii weynaadaan.
Waa maxay 'dhaqso jilicsan' ee hagaajinta degdega ah?
Dareennada jilicsan waa kuwa la tababari karo oo joogto ah oo ku dhexjira meel bannaan, ee maaha ereyo dadku akhriyi karo.
Halkee bay hagaajinta degdega ah ku soo kordhinaysaa faa'iidooyinkeeda la tababari karo?
Hagaajinta degdega ah waxay udiyaarisaa dardargelin jilicsan oo keliya gelinta, taas oo ah waxa ka fududeeya hagaajinta horgalayaasha.
Waa maxay saamaynta la yaabka leh ee warqaddii asalka ahayd ay iftiimisay miisaanka moodeelka?
Cinwaanka warqadu wuxuu xooga saaray 'awoodda miisaanka': moodooyinka waaweyni waxay u oggolaanayaan inay si degdeg ah u hagaajiyaan xafiiltanka si fiican u hagaajin.
Yaa keenay hagaajin degdeg ah?
Brian Lester, Rami Al-Rfou, iyo Nuux Constant oo jooga Google waxay daabaceen warqada hagaajinta degdega ah 2021.
Sidee bay u hagaajinta degdega ah u suurtogelisaa u adeegida hawlo badan hal nooc?
Keliya degdeg yar oo jilicsan ayaa hawl gaar ah, sidaa awgeed hal nooc oo la qaboojiyey ayaa martigelin kara hawlo badan iyadoo la beddelayo dardargelinta.