Ọkpụkpụ-nke-Echere Ndozi ndakọrịta
Skeleton-of-Thought (SoT) bụ usoro mkpali na ngbanwe nke na-ebu ụzọ jụọ ụdị asụsụ ka o depụta obere ọkpụkpụ nke isi azịza, wee gbasaa isi ihe ọ bụla n'otu n'otu.
Nchịkọta
It matters because it can cut the wall-clock latency of long answers by roughly 2x without retraining the model.
Ime miri emi
Ụdị asụsụ buru ibu na-emepụtakarị otu akara n'otu oge, ya mere azịza dị ogologo na-adị ngwa ngwa n'ihi na okwu ọ bụla na-echere nke dị ya n'ihu. Skeleton-of-Thought, nke ndị nyocha na Tsinghua webatara na Microsoft na 2023, na-ahazigharị ọrụ ahụ. Oku nke mbụ na-ajụ ihe nlereanya maka ọkpụkpụ terse: ndepụta ọnụ ọgụgụ nke isi isi 3 ruo 10, nke ọ bụla bụ okwu ole na ole. Oku nke abụọ wee gbasaa isi ihe ọ bụla n'onwe ya na otu oge, n'ihi na isi ihe anaghị adabere n'otu n'otu. A na-ekekọta mgbasawanye ndị ahụ ọnụ na azịza ikpeazụ. N'ihi na usoro mgbasawanye ngwa ngwa na-aga n'otu n'otu, ngụkọta latency na-ada nke ọma maka ajụjụ ndị azịza ha na-adaba n'ime akụkụ ndị nwere onwe ha, dị ka ndetu ndụmọdụ ma ọ bụ atụnyere nhọrọ.
Nghọta nka nka
SoT na-erigbu na nkwubi okwu decoder bụ nke ejigidere, ọ bụghị mgbe niile na-agbakọ: otu arịrịọ na-ahapụkarị GPU ejighị ya. Mgbasa ebe na-agba ọsọ dị ka ogbe na-eme ka ngwaike na-arụsi ọrụ ike ma na-agafe ọgbọ nke ọ bụla. Site na ụdị API, a na-enye mgbasawanye ahụ dị ka arịrịọ ndị na-emekọ ihe ọnụ; na ụdị mpaghara, ha na-ekekọrịta otu ngafe aga n'ihu. Ọkpụkpụ ọkpụkpụ na-agbakwunye obere ihe dị n'elu, yabụ ọsọ ọsọ net na-eto n'ogologo azịza yana ọnụ ọgụgụ isi ihe nọọrọ onwe ya.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke Mkpebi Mgbakwunye Ọkpụkpụ-nke-Thought
Na-atụ anya ka echiche SoT ga-ejikọta na ntụgharị mgbanwe: sistemu ga-achọpụta mgbe ajụjụ na-emebi nke ọma wee gbanwee gaa na mgbasawanye yiri ya, na-adaghachi n'echiche usoro maka ọrụ dabere kpamkpam dị ka ihe akaebe mgbakọ na mwepụ. Ụdị dị iche iche dị ka SoT nwere ndabere eserese dị ike na-enye ohere ka ihe na-arụtụ aka n'otu n'otu. Dị ka usoro ọrụ na-agbakwụnye nkwado sub-arịrịọ batched na nhọpụta ntule, atumatu nbibi ga-abụ ọkọlọtọ mbelata nkwụsịtụ kama ịbụ aghụghọ ngwa ngwa ngwa ngwa.
Mmejuputa n'ezie n'ụwa
Ịmelite ngwa ngwa chatbot na-aza 'nye m ndụmọdụ 8 maka ibelata ọnụ ahịa igwe ojii' site na ịgbasa ndụmọdụ asatọ niile n'otu oge.
Onye enyemaka na-akwado ndị ahịa na-emepụta ntuziaka nchọpụta nsogbu ọtụtụ ngalaba ahaziri ahazi yana obere nzaghachi nzaghachi.
Na-ewepụta azịza ntụnyere (uru na ọghọm nke ngwaahịa abụọ) ebe mgbọ ọ bụla jupụtara n'otu oge.
Sistemụ na-eje ozi na-akwado ngalaba azịza onwe ha iji bulie ojiji GPU n'oge ọgbọ dị ogologo.
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Skeleton-of-Thought Parallel Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
MaskGIT Parallel Token Decoding
Ajụjụ a na-ajụkarị
What is Skeleton-of-Thought Parallel Decoding?
Skeleton-of-Thought (SoT) bụ usoro mkpali na ngbanwe nke na-ebu ụzọ jụọ ụdị asụsụ ka o depụta obere ọkpụkpụ nke isi azịza, wee gbasaa isi ihe ọ bụla n'otu n'otu. Ọ dị mkpa n'ihi na ọ nwere ike belata nkwụsị elekere mgbidi nke azịza ogologo site na 2x na-enweghị ịzụghachi ihe nlereanya.
Kedu ihe ọkwa mbụ nke Skeleton-of-Thought na-emepụta?
SoT na-ebu ụzọ mee ka ihe nlereanya ahụ wepụta skeleton isi isi, nke na-agbasawanye iche.
Kedu ihe kpatara ọkwa ịgbasa n'isi nwere ike na-aga n'otu n'otu?
A na-emepụta isi ọkpụkpụ ka ọ bụrụ nke onwe ya, ya mere ịgbasa ha anaghị achọ ichere ụmụnne.
Kedu ihe bụ isi ebumnuche SoT na ngbanwe LLM nkịtị?
Ọkọlọtọ ntọpụta ngbanwe na-ejigide latency n'ihi na akara ngosi ọ bụla na-echere nke mbụ; SoT overlaps na-arụ ọrụ iji belata oge elekere mgbidi.
Kedu ụdị ajụjụ SoT na-enye nnukwu ọsọ ọsọ?
Azịza ndị na-emebi n'ọtụtụ akụkụ nọọrọ onwe ha na-erite uru karịa, ebe akụkụ nke ọ bụla na-agbasa n'otu oge.
Kedu ihe karịrị ego SoT na-agbakwunye ma e jiri ya tụnyere otu ọgbọ n'usoro?
Ọkpụkpụ ọkpụkpụ na-agbakwụnye ntakịrị nkwụsịtụ emechiri emechi, bụ nke karịrị mgbasawanye n'otu n'otu na azịza dị ogologo.