Umutwe wa Medusa
Medusa nuburyo bwo gutondeka-gushushanya uburyo butandukanye bwo guhanura 'imitwe' kurugero rwururimi kugirango rushobore gukeka ibimenyetso byinshi bizaza icyarimwe.
Incamake
By verifying these guesses in a single forward pass, it speeds up text generation roughly 2-3x without changing the model's output distribution.
Kwibira cyane
Ururimi rusanzwe rwerekana icyerekezo kimwe kuri pass imbere, itinda kuko buri ntambwe igomba gutegereza iyambere. Medusa yongeramo ibiryo byoroheje-bigana imitwe hejuru yicyitegererezo cyahagaritswe; buri mutwe uhanura ikimenyetso imyanya mike imbere (umutwe 1 uhanura ikimenyetso gikurikira, umutwe 2 ikimenyetso nyuma, nibindi). Ubuhanuzi bugira igiti cyo gukomeza abakandida. Icyitegererezo cyuzuye noneho kigenzura igiti cyose mumurongo umwe ukoresheje mask 'igiti kwitondera', ukemera prefix ndende ijyanye nibyo icyitegererezo cyaba cyarakoze. Kuberako verisiyo ikoresha icyitegererezo cyumwimerere, Medusa nta gihombo: inyandiko yemewe nukuri nibyo umururumba cyangwa icyitegererezo cya decoding yaba yarabyaye, gusa byakozwe mubyiciro bike bikurikiranye.
Ubushishozi
Buri mutwe wa Medusa ni ntoya MLP isigaye ishushanya icyitegererezo cyibanze cyanyuma cyihishe kugeza kugabanwa hejuru yikimenyetso kuri offset k. Abakandida bava mumitwe batunganijwe mubiti, kandi mask yubatswe idasanzwe ireka icyitegererezo cyibanze amanota buri shami icyarimwe mumwanya umwe. Gahunda isanzwe-yo kwemeranya ihitamo ibimenyetso byerekana kubika, byemeza ko ibisubizo bihuye nicyitegererezo cyibanze cyicyitegererezo, bityo ubuziranenge bukabikwa mugihe intambwe zikurikiranye zigabanuka.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Medusa Decoding Imitwe
Gukoresha decoding yibintu bigenda bihinduka mubisanzwe byerekana umusaruro, kandi uburyo bwonyine bwonyine nka Medusa, bwirinda gukenera umushinga wihariye, burashimishije kuko bworoshye kubwohereza. Akazi kazoza gahuza imitwe-yuburyo bwa Medusa hamwe nuburyo bwa EAGLE buranga guhanura, kubaka ibiti neza, hamwe no kugenzura ibyuma. Tegereza kwishyira hamwe muburyo bwo gutanga serivisi, guhuza byikora kumiterere yibiti kumurimo wakazi, no guhuza hamwe na KV-cache compression kugirango ubukererwe bugabanuke nta GPU yongeyeho cyangwa gutakaza ubuziranenge.
Gushyira mu bikorwa Isi
Gukata chatbot igisubizo cyatinze mukwemera ibimenyetso byinshi byagenzuwe kuri pass imbere
Kwihutisha code-kurangiza abafasha aho guhanura ibimenyetso bikurikirana byoroshye kubitekerezaho
Kugabanya igiciro cyimyanzuro yimodoka nyinshi LLM APIs udakoresheje umushinga wihariye
Kwihutisha imiterere miremire yinyandiko nkincamake mugihe ibisohoka bisa na decoding isanzwe
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Medusa Decoding Heads quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gusubiramo Ibihano no Kugenzura Igenzura
Ibibazo bikunze kubazwa
What is Medusa Decoding Heads?
Medusa nuburyo bwo gutondeka-gushushanya uburyo butandukanye bwo guhanura 'imitwe' kurugero rwururimi kugirango rushobore gukeka ibimenyetso byinshi bizaza icyarimwe. Mugenzura ibi bitekerezo mumurongo umwe wimbere, byihutisha ibisekuruza byanditse hafi 2-3x idahinduye icyitegererezo cyo gukwirakwiza.
Niki imitwe yinyongera ya Medusa ihanura?
Buri mutwe wa Medusa uhanura ikimenyetso cyimyanya myinshi mugihe kizaza, bityo ibimenyetso byinshi birashobora gutangwa icyarimwe.
Kuki Medusa ifatwa nk '' igihombo 'ugereranije na decoding isanzwe?
Icyitegererezo fatizo kigenzura ibimenyetso byabakandida, bakemera gusa ibyo byatanze uko byagenda kose, bikomeza ibisaranganya.
Ni ubuhe buryo abakandida ba Medusa bakomeza kugira ngo bagenzurwe?
Abakandida bagize igiti, kandi igiti cyo kwitondera igiti kireka icyitegererezo kigenzura amashami yose muri pass imwe.
Ni izihe nyungu zingenzi za Medusa kurenza umushinga-moderi udasanzwe?
Medusa ifata imitwe yoroheje kuri moderi iriho, ntabwo rero bikenewe guhugura no gutanga umushinga wihariye.
Hafi ya niyihe umuvuduko Medusa atangaza?
Medusa muri rusange igera hafi ya 2-3x igabanya ubukererwe bwibisekuru bitewe numurimo mukazi.