Ururimi AI

Gutandukanya ibintu

Kontode itandukanye itanga inyandiko-yujuje ubuziranenge mugukuramo imyifatire yururimi ruto, rudakomeye rwururimi ruva murwego runini, rukomeye.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Igihe kizaza cyo gutandukanya ibintu
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Yongera ibyo umuhanga azi kandi abikunda babuze, kugabanya gusubiramo nibisohoka.

Kwibira cyane

Contrastive decoding scores candidate tokens using an expert model and an amateur model, subtracting a weighted amateur log-probability from the expert score. It can suppress tokens that both models favor, including some generic or repetitive continuations. An adaptive plausibility constraint filters out tokens whose expert probability is too small relative to the expert’s highest-probability token. This constraint limits candidates; it does not guarantee coherent, grammatical, or truthful output. Output quality depends on the models, coefficient, threshold, prompt, and task, so evaluate the full generation. The method runs at inference time with two models and requires no additional training.

Gushyira mu bikorwa Isi

Kubyara inkuru ndende, idasubirwamo cyangwa ingingo ikomeza aho nucleus sampling igenda ijya mumuzinga

Guhuza impuguke ya 65B hamwe na 1.5B yikinira kugirango utezimbere ibisekuruza byafunguye neza neza

Kugabanya gusubiramo kwangirika mugusubiramo hamwe nibisubizo byibiganiro

Gukora nkibishingiro bya DoLa-yuburyo bwo kwigereranya no gutandukanya ibintu bifatika

Igihe kizaza cyo gutandukanya ibintu

Gutandukanya ibintu bitandukanye byashishikarije umuryango 'gutandukanya itandukaniro', harimo DoLa (itandukanye nicyitegererezo cyambere cyambere nicyiciro cyatinze kugirango ugabanye salusiyo) hamwe nuburyo bwo kumenya imiterere itandukanye kandi idafite inyandiko zabonetse. Witegereze kwishyira hamwe hamwe no kugarura ibintu, gutanga amanota yukuri, hamwe no gutandukanya amateur mato, wongeyeho guhuza hamwe na decoding ya spekulifike bityo abikunda bayobora ubuziranenge kandi byihutisha ibisekuruza icyarimwe.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Umuvuduko n'igipimo. Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
  • Kugera no kugera. Yagura uburyo bwindimi nuburyo bwo gutumanaho.
  • Ibyemezo bisobanutse. Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Witondere

  • Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
  • Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
  • Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Intambwe ikurikira

  1. Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
  2. Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
  3. Komeza kugenzura abantu kugenzura ibisubizo byinshi.
  4. Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Contrastive Decoding quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Decoding Itandukanye Niki?

Kontode itandukanye itanga inyandiko-yujuje ubuziranenge mugukuramo imyifatire yururimi ruto, rudakomeye rwururimi ruva murwego runini, rukomeye. Yongerera ibyo umuhanga azi kandi abikunda babuze, kugabanya gusubiramo nibisohoka.

Mu buryo butandukanye bwo gushushanya, ni uruhe ruhare ruto 'rwikinisha' rufite?

Amateur ya log-probabilite yakuwe muby'impuguke, ikuraho amakosa atunganijwe (nko gutonesha ibimenyetso kenshi) moderi zombi zisangiye.

Ni ukubera iki gukuramo amahirwe yo kwikinisha bigabanya gusubiramo no gusohora bland?

Moderi zombi zikunda guhitamo cyane-inshuro nyinshi kandi zisubiramo; gukuramo amateur bivanaho kubogama gusangiye, kumanura bland guhitamo.

What does the adaptive plausibility constraint do in contrastive decoding?

The constraint removes low-expert-probability tokens before contrastive scoring; it does not certify the coherence or truth of the final output.

Hafi ya formula yo gutanga amanota muri decoding itandukanye?

Buri mukandida atsindirwa nkimpuguke ya log-probabilus ukuyemo uburemere bwikinamico bwikigereranyo, ibihembo bihebuje umuhanga akunda bidasanzwe.

Nubuhe buryo bwanyuma bwagura igitekerezo gitandukanye kurwego rumwe rwihariye?

DoLa itandukanye nicyitegererezo cyigihe kitaragera (kare-layer) hamwe nubukure (butinze-buke) guhanura kugabanya salusiyo, ukoresheje igitekerezo gitandukanye muburyo bumwe.