Qalfoofka-Fikirka Isbarbar-dhigga Codaynta
Qalfoofka-Fikirka (Skeleton-of-Thought) (SoT) waa farsamo kicinta iyo dejinta oo marka hore waydiisa qaabka luqadda si uu u qeexo qalfoof kooban oo dhibcaha jawaabta ah, ka dibna balaadhiya dhibco kasta oo barbar socda.
Dulmar
It matters because it can cut the wall-clock latency of long answers by roughly 2x without retraining the model.
quusid qoto dheer
Moodooyinka luqadaha waaweyni waxay sida caadiga ah dhaliyaan hal calaamad markiiba, markaa jawaabta dheer waa mid gaabis ah sababtoo ah erey kastaa wuxuu sugayaa kii ka horreeyay. Qalfoofka-Fikirka, oo ay soo bandhigeen cilmi-baarayaasha Tsinghua iyo Microsoft sanadka 2023, ayaa dib u habayn ku sameeya shaqada. Wicitaanki hore waxa uu ku waydiinayaa moodelka qalfoofka qalfoofka ah: liis la tiriyey oo ah 3 ilaa 10 dhibcood, mid walbana dhawr kelmadood. Dufcaddii labaad ee wicitaanada ayaa markaa balaadhisa qodob kasta si madaxbannaan oo isku mar ah, sababtoo ah dhibcuhu iskuma xidhna. Balaadhinta ayaa dib loogu tolaa jawaabta u dambaysa. Sababtoo ah heerka balaadhinta qunyar socodka ah wuxuu u socdaa si barbar socda, wadarta daahitaanka ayaa si aad ah hoos ugu dhacaya su'aalaha jawaabahooda si dabiici ah u jajaban qaybo madaxbannaan, sida liiska talooyinka ama isbarbardhigga ikhtiyaarrada.
Aragtida Farsamada
SoT waxay ka faa'iidaysataa in soo jeedinta cod-bixiyayaashu ay ku xidhan tahay daahitaanka, had iyo jeer kuma xidhna: hal codsi ayaa inta badan ka taga GPU-ga oo aan laga faa'iidaysan. Ballaarinta dhibicda orodka ee dufcaddii ahaan waxay ka dhigtaa qalabku mashquul oo wuxuu isku rogaa jiilka dhibic kasta. Moodooyinka API, balaadhinta waxaa loo soo saaray codsiyo isku mid ah; oo wata moodallo maxalli ah, waxay wadaagaan hal baas oo hore u dufcadaysan. Marxaladda qalfoofku waxay ku daraysaa dusha sare ee gaaban oo go'an, markaa xawaaraha saafiga ah wuxuu ku koraa dhererka jawaabta iyo tirada dhibcaha madax-bannaan.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Qalfoofka-Fikirka Isbarbar-dhigga
Filo fikradaha SoT inay ku milmaan dariiqa la qabsiga: nidaamyadu waxay ogaan doonaan marka su'aaluhu si nadiif ah u kala jajabaan oo ay u beddelaan ballaarinta barbar-dhigga, dib ugu noqoshada sababaha isdaba-joogga ah ee hawlaha si adag ugu tiirsan sida caddaynta xisaabta. Kala duwanaanshiyaha sida SoT oo leh ku tiirsanaanta garaafyada firfircooni waxay oggolaadaan dhibcaha midba midka kale tixraacayo. Sida qaab-dhismeedyada u adeegidda ay ku darayaan taageero codsi hoose oo dufcadaysan iyo dejinta malo-awaalka ah, xeeladaha kala-baxa isbar-bar-dhigga waxay noqonayaan lakabka-yaraynta daahista caadiga ah halkii ay ka ahaan lahaayeen farsamo degdeg ah oo gacanta ah.
Dhaqangelinta Adduunka-dhabta ah
Dadajinta chatbot-ka kaas oo ka jawaabaya 'isii 8 talo oo lagu dhimayo kharashaadka daruuraha' adiga oo balaadhinaya dhammaan siddeedda talo hal mar.
Kaaliyaha taageerada macmiilka ee soo saara hagaha cilad-raadinta qaybo badan oo habaysan oo leh daahsoon jawaabeed hoose.
Soo saarista jawaabta isbarbardhigga (faa'iidooyinka iyo khasaarooyinka laba badeecooyin) halkaasoo xabbad kasta si isku mid ah loo buuxiyo.
Nidaamyada u adeegida dhabarka oo soo koobaya qaybo jawaabo madax banaan si kor loogu qaado ka faa'iidaysiga GPU inta lagu jiro jiilka qaab-dheer.
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Skeleton-of-Thought Parallel Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
MaskGIT Parallel Token Decoding
Su'aalaha soo noqnoqda
What is Skeleton-of-Thought Parallel Decoding?
Qalfoofka-Fikirka (Skeleton-of-Thought) (SoT) waa farsamo kicinta iyo dejinta oo marka hore waydiisa qaabka luqadda si uu u qeexo qalfoof kooban oo dhibcaha jawaabta ah, ka dibna balaadhiya dhibco kasta oo barbar socda. Waa arrin sababtoo ah waxay gooyn kartaa daahitaanka saacadaha gidaarka ee jawaabaha dhaadheer qiyaas ahaan 2x iyada oo aan dib loo tababarin qaabka.
Muxuu soo saaraa marxaladda koowaad ee Qalfoofka-Fikirka?
SoT ayaa marka hore ku dhiirigelisa moodelka inuu sii daayo qalfoofka ciwaanka dhibcaha, ka dibna si gooni ah loo ballaariyay.
Waa maxay sababta heerka dhibic-ballaadhintu uu u socon karaa is barbar socda?
Dhibcaha qalfoofka waxaa loogu talagalay inay noqdaan kuwo madaxbannaan, sidaas awgeed ballaarinta iyaga uma baahna sugitaanka walaalaha.
Waa maxay cilad-xumada ugu weyn ee bartilmaameedyada SoT ee qaabaynta LLM ee caadiga ah?
Go'aaminta caadiga ah waxay ku xidhan tahay daahitaanka sababtoo ah calaamad kasta waxay sugaysaa kii hore; Isku dhufashada SoT waxay u shaqeysaa si loo dhimo wakhtiga gidaarka.
Su'aal noocee ah ayay SoT ku siinaysaa xawaaraha ugu weyn?
Jawaabaha u kala go'a qaybo badan oo madax banaan ayaa faa'iido badan u leh, maadaama qayb kastaa ay si isku mid ah u fidayso.
Waa maxay kharashka SoT ku darayaa marka la barbar dhigo hal jiil oo isku xiga?
Marxaladda qalfoofku waxay ku darsataa daahitaan yar oo go'an, kaas oo ka miisaan balaadhinta barbar socota ee jawaabaha dhaadheer.