Gutandukanya ibintu
Kontode itandukanye itanga inyandiko-yujuje ubuziranenge mugukuramo imyifatire yururimi ruto, rudakomeye rwururimi ruva murwego runini, rukomeye.
Incamake
Yongera ibyo umuhanga azi kandi abikunda babuze, kugabanya gusubiramo nibisohoka.
Kwibira cyane
Iyo imvugo y'ururimi itoye ijambo rikurikira, itanga amahirwe hejuru yamagambo yayo. Gutandukanya ibintu bitandukanye (byatangijwe na Li n'abandi muri 2022) bikoresha moderi ebyiri murwego rumwe: 'umuhanga' munini na 'amateur' muto. Aho kwizera impuguke zishoboka, itanga amanota buri mukandida ikimenyetso cyerekana itandukaniro riri hagati yimpuguke-y’impuguke n’abakunzi. Tokens abahanga batonesha ariko abikunda ntabwo bazamurwa; amagambo rusange moderi zombi zikunda (nka 'the' cyangwa interuro zisubirwamo) zirahagarikwa, kubera ko abikunda nabo babakunda. Akayunguruzo gashobora kubanza guta ibimenyetso umuhanga abona ko bidashoboka, bityo itandukaniro ntirishobora guteza ubuswa. Igisubizo kirasobanutse neza, gihuje, kandi ntigisubirwamo inyandiko ndende-ndende kuruta umururumba cyangwa nucleus sampling, nta mahugurwa y'inyongera asabwa.
Ubushishozi
Amanota yibanze ni log p_expert (token) ukuyemo inshuro coefficient inshuro p_amateur (ikimenyetso). Kuberako amateur asangiye amakosa yinzobere (gutonesha ibimenyetso byinshi-byihuta, gusubiramo, gusubiramo gusubiramo), gukuramo log-probabilite bihagarika ubwo buryo bwo gutsindwa mugihe cyo kubika ubumenyi bwinzobere. Inzitizi yo guhuza n'imihindagurikire y'ikirere igumya gusa ibimenyetso hejuru y'agace (alpha) k'impuguke zo hejuru zishoboka, bikabuza itandukaniro ryo kongera amagambo adasanzwe, adahuye.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Igihe kizaza cyo gutandukanya ibintu
Gutandukanya ibintu bitandukanye byashishikarije umuryango 'gutandukanya itandukaniro', harimo DoLa (itandukanye nicyitegererezo cyambere cyambere nicyiciro cyatinze kugirango ugabanye salusiyo) hamwe nuburyo bwo kumenya imiterere itandukanye kandi idafite inyandiko zabonetse. Witegereze kwishyira hamwe hamwe no kugarura ibintu, gutanga amanota yukuri, hamwe no gutandukanya amateur mato, wongeyeho guhuza hamwe na decoding ya spekulifike bityo abikunda bayobora ubuziranenge kandi byihutisha ibisekuruza icyarimwe.
Gushyira mu bikorwa Isi
Kubyara inkuru ndende, idasubirwamo cyangwa ingingo ikomeza aho nucleus sampling igenda ijya mumuzinga
Guhuza impuguke ya 65B hamwe na 1.5B yikinira kugirango utezimbere ibisekuruza byafunguye neza neza
Kugabanya gusubiramo kwangirika mugusubiramo hamwe nibisubizo byibiganiro
Gukora nkibishingiro bya DoLa-yuburyo bwo kwigereranya no gutandukanya ibintu bifatika
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Contrastive Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Nibura Bayes Risk Decoding
Ibibazo bikunze kubazwa
Decoding Itandukanye Niki?
Kontode itandukanye itanga inyandiko-yujuje ubuziranenge mugukuramo imyifatire yururimi ruto, rudakomeye rwururimi ruva murwego runini, rukomeye. Yongerera ibyo umuhanga azi kandi abikunda babuze, kugabanya gusubiramo nibisohoka.
Mu buryo butandukanye bwo gushushanya, ni uruhe ruhare ruto 'rwikinisha' rufite?
Amateur ya log-probabilite yakuwe muby'impuguke, ikuraho amakosa atunganijwe (nko gutonesha ibimenyetso kenshi) moderi zombi zisangiye.
Ni ukubera iki gukuramo amahirwe yo kwikinisha bigabanya gusubiramo no gusohora bland?
Moderi zombi zikunda guhitamo cyane-inshuro nyinshi kandi zisubiramo; gukuramo amateur bivanaho kubogama gusangiye, kumanura bland guhitamo.
Imbogamizi yo guhuza n'imihindagurikire y'ikirere ikora iki?
Akayunguruzo gashoboka kata ibimenyetso bike-bishoboka munsi yinzobere, bityo itandukaniro ntirishobora guteza imbere amagambo adahuye cyangwa adafite ishingiro.
Hafi ya formula yo gutanga amanota muri decoding itandukanye?
Buri mukandida atsindirwa nkimpuguke ya log-probabilus ukuyemo uburemere bwikinamico bwikigereranyo, ibihembo bihebuje umuhanga akunda bidasanzwe.
Nubuhe buryo bwanyuma bwagura igitekerezo gitandukanye kurwego rumwe rwihariye?
DoLa itandukanye nicyitegererezo cyigihe kitaragera (kare-layer) hamwe nubukure (butinze-buke) guhanura kugabanya salusiyo, ukoresheje igitekerezo gitandukanye muburyo bumwe.