Ururimi AI
Gutandukanya ibintu
Kontode itandukanye itanga inyandiko-yujuje ubuziranenge mugukuramo imyifatire yururimi ruto, rudakomeye rwururimi ruva murwego runini, rukomeye.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
Yongera ibyo umuhanga azi kandi abikunda babuze, kugabanya gusubiramo nibisohoka.
Kwibira cyane
Contrastive decoding scores candidate tokens using an expert model and an amateur model, subtracting a weighted amateur log-probability from the expert score. It can suppress tokens that both models favor, including some generic or repetitive continuations. An adaptive plausibility constraint filters out tokens whose expert probability is too small relative to the expert’s highest-probability token. This constraint limits candidates; it does not guarantee coherent, grammatical, or truthful output. Output quality depends on the models, coefficient, threshold, prompt, and task, so evaluate the full generation. The method runs at inference time with two models and requires no additional training.
Gushyira mu bikorwa Isi
Kubyara inkuru ndende, idasubirwamo cyangwa ingingo ikomeza aho nucleus sampling igenda ijya mumuzinga
Guhuza impuguke ya 65B hamwe na 1.5B yikinira kugirango utezimbere ibisekuruza byafunguye neza neza
Kugabanya gusubiramo kwangirika mugusubiramo hamwe nibisubizo byibiganiro
Gukora nkibishingiro bya DoLa-yuburyo bwo kwigereranya no gutandukanya ibintu bifatika
Igihe kizaza cyo gutandukanya ibintu
Gutandukanya ibintu bitandukanye byashishikarije umuryango 'gutandukanya itandukaniro', harimo DoLa (itandukanye nicyitegererezo cyambere cyambere nicyiciro cyatinze kugirango ugabanye salusiyo) hamwe nuburyo bwo kumenya imiterere itandukanye kandi idafite inyandiko zabonetse. Witegereze kwishyira hamwe hamwe no kugarura ibintu, gutanga amanota yukuri, hamwe no gutandukanya amateur mato, wongeyeho guhuza hamwe na decoding ya spekulifike bityo abikunda bayobora ubuziranenge kandi byihutisha ibisekuruza icyarimwe.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Umuvuduko n'igipimo. Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
- Kugera no kugera. Yagura uburyo bwindimi nuburyo bwo gutumanaho.
- Ibyemezo bisobanutse. Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Witondere
- Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
- Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
- Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Intambwe ikurikira
- Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
- Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
- Komeza kugenzura abantu kugenzura ibisubizo byinshi.
- Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the Contrastive Decoding quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
Decoding Itandukanye Niki?
Kontode itandukanye itanga inyandiko-yujuje ubuziranenge mugukuramo imyifatire yururimi ruto, rudakomeye rwururimi ruva murwego runini, rukomeye. Yongerera ibyo umuhanga azi kandi abikunda babuze, kugabanya gusubiramo nibisohoka.
Mu buryo butandukanye bwo gushushanya, ni uruhe ruhare ruto 'rwikinisha' rufite?
Amateur ya log-probabilite yakuwe muby'impuguke, ikuraho amakosa atunganijwe (nko gutonesha ibimenyetso kenshi) moderi zombi zisangiye.
Ni ukubera iki gukuramo amahirwe yo kwikinisha bigabanya gusubiramo no gusohora bland?
Moderi zombi zikunda guhitamo cyane-inshuro nyinshi kandi zisubiramo; gukuramo amateur bivanaho kubogama gusangiye, kumanura bland guhitamo.
What does the adaptive plausibility constraint do in contrastive decoding?
The constraint removes low-expert-probability tokens before contrastive scoring; it does not certify the coherence or truth of the final output.
Hafi ya formula yo gutanga amanota muri decoding itandukanye?
Buri mukandida atsindirwa nkimpuguke ya log-probabilus ukuyemo uburemere bwikinamico bwikigereranyo, ibihembo bihebuje umuhanga akunda bidasanzwe.
Nubuhe buryo bwanyuma bwagura igitekerezo gitandukanye kurwego rumwe rwihariye?
DoLa itandukanye nicyitegererezo cyigihe kitaragera (kare-layer) hamwe nubukure (butinze-buke) guhanura kugabanya salusiyo, ukoresheje igitekerezo gitandukanye muburyo bumwe.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo