Ururimi AI

Ibyiza-bya-N Gutoranya na Reranking

Ibyiza-bya-N icyitegererezo bitanga ibisubizo byinshi byabakandida uhereye kumurongo hanyuma ugahitamo icyiza ukoresheje intambwe itandukanye.

2 min somaIbiherutse kuvugururwa

Incamake

It is one of the simplest, most reliable ways to trade extra compute at inference time for higher answer quality.

Kwibira cyane

Ururimi rwicyitegererezo hamwe nicyitegererezo rutanga ibisubizo bitandukanye igihe cyose ubikoresheje. Ibyiza-bya-N bikoresha ibi: ushushanya N abakandida ibisubizo, hanyuma ubisubiremo hanyuma usubize hejuru. Urutonde rushobora kuba urugero rwigihembo cyize (rusanzwe mukwiga gushimangira ibitekerezo byabantu), umugenzuzi ugenzura ukuri, cyangwa heuriste yoroshye nkamasezerano yo gusubiza binyuze mumatora menshi. Kuberako icyitegererezo gikeneye igerageza rimwe gusa muri benshi, ubuziranenge burazamuka cyane uko N ikura, cyane cyane kubitekerezo hamwe nimirimo ya code aho inzira nziza ibaho ariko ntabwo buri gihe icyitegererezo cyambere. Igiciro ni umurongo muri N, kandi inyungu amaherezo plateau cyangwa niyo ihinduka niba uwatsinze amanota adatunganye, uburyo bwo gutsindwa bwitwa ibihembo hacking cyangwa ibihembo birenze urugero.

Ubushishozi

Ubwiza bwa-N-hinges rwose kubatsinze. Hamwe nogusuzuma neza, ubunyangamugayo bwegera amahirwe yuko byibura imwe murugero rwa N ikwiye, izamuka vuba hamwe na N. Hamwe nicyitegererezo cyigihembo cyurusaku, guhitamo birashobora gushukwa: gusunika N cyane cyane byongera umusaruro utanga amanota menshi ariko mubyukuri arikose, kubera ko urimo uhitamo guhangana nimpumyi zitanga amanota. Niyo mpamvu moderi ya Calibrated, ikomeye ibihembo byingenzi kubuhanga bwo gukomeza kwishyura.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.

Kugera no kugera

Yagura uburyo bwindimi nuburyo bwo gutumanaho.

Ibyemezo bisobanutse

Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Ejo hazaza heza-N-Gutoranya na Reranking

Ibyiza-bya-N bihinduka inyubako yibanze yo kugereranya-igihe cyo gupima, hamwe nuruhererekane-rwibitekerezo no gushakisha ibiti. Tegereza ibintu byubwenge buke: gutora amajwi aremereye, gutora ibihembo byerekana amanota buri ntambwe yo gutekereza, hamwe na adaptive N ihagarika icyitegererezo iyo ikizere ari kinini. Mugihe abagenzuzi batera imbere, cyane cyane kode n imibare aho gukosorwa kugenzurwa, gutondekanya ingero nyinshi bizaba inzira isanzwe yo guhindura ibicuruzwa byabigenewe mu kwizerwa utarinze gusubiramo icyitegererezo.

Gushyira mu bikorwa Isi

Gutoranya ibisubizo 64 kubibazo byimibare no guhitamo igisubizo ingero nyinshi zemeranyaho (kwiyitaho / gutora ubwinshi).

Kubyara kode nyinshi zuzuza no kugumana imwe yatsinze ibizamini byinshi nkibigenzurwa byikora.

Gushushanya ibisubizo byinshi mumuyoboro wa RLHF no guhitamo ibihembo-bihebuje-byerekana-amanota-yo gusubiza kubakoresha.

Gukora inyandiko nyinshi zincamake no kuzisubiza hamwe nicyitegererezo cyiza cyo gusubiza abizerwa, bagufi.

Ingaruka & Kurinda

Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.

Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.

Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Igishushanyo mbonera

1

Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.

2

Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.

3

Komeza kugenzura abantu kugenzura ibisubizo byinshi.

4

Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Best-of-N Sampling and Reranking quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Ubushyuhe no Guhitamo

Ibibazo bikunze kubazwa

What is Best-of-N Sampling and Reranking?

Ibyiza-bya-N icyitegererezo bitanga ibisubizo byinshi byabakandida uhereye kumurongo hanyuma ugahitamo icyiza ukoresheje intambwe itandukanye. Nimwe muburyo bworoshye, bwizewe bwo gucuruza mudasobwa mugihe cyo kugereranya ibisubizo byiza.

Ni ikihe gitekerezo cyibanze cyiza-cya N icyitegererezo?

Ibyiza-bya-N bikurura ibisubizo byinshi byabakandida hanyuma bikabisubiramo, bigasubiza amanota menshi.

Ni ubuhe bwoko bw'imirimo nziza-ya-N ikunda gufasha cyane?

Iyo hari igisubizo cyukuri gifatika icyitegererezo gisanga rimwe na rimwe, gutoranya abakandida benshi bizamura amahirwe umuntu afite ukuri.

Niki kigaragaza ahanini niba ibyiza-bya-N bizamura ibisubizo koko?

Guhitamo nibyiza gusa nka reranker; umunyantege nke cyangwa abogamye arashobora guhitamo ibisubizo bitari byo.

Ni ubuhe buryo bwo kunanirwa bushobora kugaragara mugihe N isunitswe cyane hamwe nicyitegererezo kidasanzwe?

Gukoresha neza cyane utanga amanota afite inenge byongera ibisubizo bikoresha ahantu hatabona, bityo ubunyangamugayo bushobora guhagarara cyangwa kugabanuka.

Ni ubuhe buryo bworoshye bwo guhindura ibintu buzwi no kwizana?

Kwiyubaka-kwigana ingero nyinshi zitekereza kandi igahitamo igisubizo cyanyuma iminyururu myinshi yemeranyaho.