Amahugurwa menshi yo guhanura
Aho guhanura ibimenyetso bizakurikiraho, icyitegererezo cyatojwe guhanura ibimenyetso byinshi bizaza icyarimwe.
Incamake
This sharpens learning signals and unlocks faster inference through self-speculative decoding.
Kwibira cyane
Ururimi rusanzwe rwimenyerejwe hamwe nubutaha-bwo guhanura: ukurikije imiterere, guhanura icyerekezo gikurikira. Ubuhanuzi bwinshi (MTP), bukunzwe nimpapuro 2024 Meta kandi bwemejwe muri DeepSeek-V3, bwongeramo imitwe yoroheje yasohotse kuburyo icyitegererezo icyarimwe gihanura ikimenyetso gikurikira hiyongereyeho ibimenyetso bya 2, icya 3, nicya 4 mbere yigihugu kimwe cyihishe. Ibi bihatira umuyoboro guteganya ejo hazaza kandi bikagabanya ibimenyetso byamahugurwa - buri mwanya ubungubu utanga amagambo menshi yo gutakaza. Meta yatangaje cyane cyane inyungu nini kuri code no gutekereza kubyara, hamwe na moderi nini zunguka byinshi. Icy'ingenzi, imitwe yinyongera irashobora gutabwa nyuma yimyitozo, bityo ingano yicyitegererezo kubyoherezwa ntigomba gukura.
Ubushishozi
MTP ifata imitwe yigenga yo guhanura hejuru yumurongo uhuriweho; umutwe k uhanura ikimenyetso kumwanya t + k uhereye kumyanya kumwanya t. Igihombo cyegeranijwe mugihe cy'amahugurwa. Mugusuzuma, imitwe yingoboka ituma kwishushanya-kwishushanya: icyitegererezo gitanga ibimenyetso byinshi mumurongo umwe, hanyuma bikabigenzura, bikagera kuri 3x byihuse byihuse bidahinduye ibisohoka.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'amahugurwa menshi yo guhanura
MTP ihinduka ibintu bisanzwe muburyo bwo gutoza imipaka kuko itezimbere ubwiza nubwisanzure ku giciro gito. Tegereza guhuza cyane hamwe na decoding yibishushanyo, guhanura byimbitse, kandi ukoreshe nk'intego ifasha itezimbere gahunda ndende. Ufatanije nuburyo bwo gutekereza, guhanura intambwe nyinshi ziri imbere birashobora gufasha abigana imbere kwigana ingaruka mbere yo kwiyemeza igisubizo.
Gushyira mu bikorwa Isi
DeepSeek-V3 ukoresheje intego ya MTP mugihe cyo kwitegura kuzamura amakuru neza no gukora decoding yibitekerezo
__AIU_PROTECTED_13 __ 'kode-yerekana kode yerekana ibyunguka byukuri kuri HumanEval na MBPP kuva guhanura ibimenyetso byinshi
Kwiyerekana-kwishushanya: gutegura ibimenyetso 3-4 kuri pass imbere hanyuma ugenzura byihuse, gukwirakwiza-kubika umusaruro
Byihuse autocomplete mubufasha ba coding aho ibimenyetso byinshi byemewe byasabwe kandi bikagenzurwa murwego rumwe
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Multi-Token Prediction Training quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gutondeka gutemba no guhanura byinshi
Ibibazo bikunze kubazwa
What is Multi-Token Prediction Training?
Aho guhanura ibimenyetso bizakurikiraho, icyitegererezo cyatojwe guhanura ibimenyetso byinshi bizaza icyarimwe. Ibi bikarishye ibimenyetso byo kwiga kandi bifungura umwanzuro wihuse ukoresheje decoding ya decoding.
Niki guhanura-ibimenyetso byinshi byiyongera ugereranije namahugurwa asanzwe-token?
MTP yongeyeho ibisohoka byimitwe kuburyo icyitegererezo gihanura ikimenyetso gikurikira wongeyeho ibimenyetso byinshi imbere yimbere ya leta ihishe.
Niyihe moderi yakoresheje cyane intego yo guhanura intego yo kwitegura?
DeepSeek-V3 yemeye intego ya MTP yo kunoza imikorere yamakuru no gukora decoding yibitekerezo.
Kuki MTP yerekana ibimenyetso byamahugurwa?
Guteganya ibimenyetso byinshi bizaza bisobanura buri mwanya wikimenyetso utanga igihombo kinini cyo guhanura, utanga ibimenyetso byinshi byo kwiga kuri buri kimenyetso.
Ni izihe nyungu zifatika imitwe yinyongera itanga?
Imitwe yingoboka irashobora gutegura ibimenyetso byinshi kuri pass noneho bigenzurwa, byihuta ibisekuru bidahinduye ibisohoka.
Bigenda bite kumutwe wabafasha nyuma yimyitozo niba udakeneye kwihuta?
Imitwe yinyongera irahitamo kubohereza; kubijugunya bikomeza icyitegererezo kingana nicyitegererezo gikurikira-token.