Nhungamiro yehunyanzvi

Nzira dzekuona dzekunyepa

Kuonekwa kwehuroyi ndiyo seti yematekiniki ekumaka modhi inobuda inhema kana isingatsigirwe nehumbowo.

Teerera kugwaro iriAI-yakarondedzerwa · ~3 min

Pa peji ino4 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reHallucination Detection Methods
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Nzira huru ndedzekuenzanisa mhinduro dzakati wandei nekutarisa kuti dzinobvumirana here, kuyedza kana chirevo chega chega chakabatanidzwa nemagwaro anowanikwa, kuverenga zvikwangwani zvekusagadzikana senge token probabilities, uye kukumbira wechipiri modhi kuti aite semutongi. Izvo zvine basa nekuti mameseji ekunyepedzera anowanzo verenga zvinyoro uye nechivimbo, saka masisitimu ekugadzira anoda otomatiki cheki zvikanganiso zvisati zvasvika kune vashandisi.

Kudzika Kwakadzika

Kuona kunobvunza mubvunzo wakamanikana pane kuti sei mamodheru achinyengedza: kupihwa zvakabuda, zvinogona kuvimbwa here? Sistimu dzakasimba dzinowanzobatanidza dzinoverengeka dzenzira dziri pazasi. Kuzviongorora kunoenderana nekutarisa kuri nyore. Kana modhi ichiziva chokwadi, masamples anodzokororwa anowanzo kubvumirana, nepo ruzivo rwakagadzirwa runowanzo siyana. SelfCheckGPT (Manakul et al., 2023) yakagadzira izvi. Inoburitsa mhinduro dzakawanda uye inoyera kana mutsara wega wega wemhinduro huru uchitsigirwa nemimwe. Nzira yacho haidi kunobva kunze. Izvo zvinokanganisa ndezvokuwedzera modhi kufona uye kukanganisa kwainopotsa kana modhi ichidzokorora mhinduro imwe isiriyo nguva dzese. Cheki-yakadzika macheki inoenzanisa zvakabuda zvichipesana nereferenzi zvinyorwa, izvo zvinoenderana nekutora-akawedzera masisitimu. Mhinduro inopatsanurwa kuita zvirevo zveatomu, uye chirevo chega chega chinoedzwa kuti chienderane nendima dzakatorwa. Entailment inoreva ndima inotsigira zvazvinoreva. Muedzo unoshandisa ingave yemutauro wekare inference modhi kana LLM. Macheki aya anoyera kutendeka kumanyuko, izvo zvisina kufanana nechokwadi kana masosi asina kururama. Kusavimbika masaini anoshandisa modhi yacho pachayo zvingangoitika. Yakaderera tokeni mikana kana yakakwira entropy pane kiyi spans senge mazita, manhamba nemazuva zvinogona kuratidza kufungidzira. Semantic entropy (Farquhar et al., yakaburitswa muNature muna 2024) mapoka akasample mhinduro nezvinoreva asati ayera kusavimbika, saka mazwi akasiyana emhinduro imwe chete haaverengwe sekusawirirana. Token-level masiginecha anoda kuwana mukana we log, izvo zvinoganhurwa nemamwe maAPI. Vatongi vemhando vanobvunza LLM yakasimba kuti itore mhinduro yezvichemo zvisina kutsigirwa, kazhinji nekwakabva uye rubriki yakasungirirwa. Ivo vanokwira zvakanaka, asi vatongi vane kwavo kurerekera uye mwero wekukanganisa, saka vatarise vachipesana nemazita evanhu. Imwe pfungwa isiriyo yakajairika ndeyekuti kubvunza muenzaniso 'une chokwadi here?' akavimbika anobata zvikanganiso. Mienzaniso inogona kusiya mhinduro dzakarurama kana kudzivirira dzisina kururama. Macheki akarongwa anovimbika zvakanyanya.

Kuitwa muNyika yeChokwadi

Chishandiso chekutsvagisa zviri pamutemo chinobvisa imwe neimwe nyaya kubva mumhinduro yekunyorwa uye inotarisa kuti imwe neimwe iripo mudhatabhesi remutemo usati waratidza mhinduro.

Bot yetsigiro inoshandisa kudzoreredza inopatsanura mhinduro yayo kuita zvirevo zvemunhu uye inotarisa imwe neimwe ichipesana nezvinyorwa zvekubatsira zvakatorwa. Zvichemo zvisina tsigiro zvinotsiviwa nenoti yaisakwanisa kusimbiswa.

Sisitimu inobvunza mubvunzo mumwechete wechokwadi kashanu nesampling randomness yakavhurwa. Kana mazuva ekuzvarwa ekudzoka achisiyana, mhinduro inocherechedzwa sekuvimba kwakaderera.

Zuva rega rega, mutongi modhi anomaka sample yezvipfupiso zvakaburitswa zvichipesana nerubriki yezvirevo zvisingatsigirwe, uye munhu anoongorora chero chaanomisa.

Ramangwana reHallucination Detection Methods

Kuonekwa kuri kuita kwakajairwa muzvigadzirwa zveAI, uye mapuratifomu ekuongorora uye vanopa makore zvino vanopa kudzika uye kutendeka cheki. Tsvagiridzo inoenderera mberi nekuverenga zviratidzo zvekusavimbika kubva mumuenzaniso wemukati activation uye pamamodheru ekudzidzira kurega kana kuti nyika yakaringana chivimbo. Hapana nzira yakakwana. Macheki ekugadzika haagone kugadzirisa zvisizvo, uye zviratidzo zvekusavimbika zvinopotsa zvikanganiso zvekuvimba. Iyo ingangove nzira inodzivirira ine layered pane imwe chete detector. Cheap deterministic cheki inouya kutanga, yobva yadzika verification, nekuongororwa kwevanhu kwepamusoro-stake kubuda.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Hallucination Detection Methods quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Hallucination Detection Methods?

Kuonekwa kwehuroyi ndiyo seti yematekiniki ekumaka modhi inobuda inhema kana isingatsigirwe nehumbowo. Nzira huru ndedzekuenzanisa mhinduro dzakati wandei nekutarisa kuti dzinobvumirana here, kuyedza kana chirevo chega chega chakabatanidzwa nemagwaro anowanikwa, kuverenga zvikwangwani zvekusagadzikana senge token probabilities, uye kukumbira wechipiri modhi kuti aite semutongi. Izvo zvine basa nekuti mameseji ekunyepedzera anowanzo verenga zvinyoro uye nechivimbo, saka masisitimu ekugadzira anoda otomatiki cheki zvikanganiso zvisati zvasvika kune vashandisi.

Ndechipi chekutarisa chiri pasi pemaitiro ekuzvimiririra seSelfCheckGPT?

Chibvumirano pamasamples ipuroksi yeruzivo. Tsanangudzo dzinochinja kubva kumuenzaniso kuenda kumuenzaniso dzinoratidza kuti modhi iri kufungidzira.

Ndechipi chinodzikisira chakakosha chekuzviongorora wega?

Kana modhi iine chivimbo uye ichikanganisa nguva dzose, sampuli dzayo dzinobvumirana uye cheki inopfuura. Kugadzira akati wandei sampuli kunowedzerawo mutengo.

Ko source-grounded etailment checks inoyera chii chaizvo?

Macheki aya anoedza kuti zvichemo zvinotsigirwa here nemagwaro ereferensi. Kana chirevo chacho chisina kururama, mhinduro yakatendeka inogona kuramba iri yenhema.

Ko semantic entropy inosiyana sei kubva nyore token-level kusavimbika?

Kuronga nechirevo kunoreva mazwi akasiyana emhinduro imwe chete haaverengwe sekusawirirana. Mhinduro dzakasiyana chete dzechokwadi dzinosimudza chibodzwa chekusavimbika.

Sei gwara richikurudzira kuti verifier itore nguva yekutsigira?

Kotesheni inodiwa inogona kutariswa zvine mutsindo uchipesana nekwakabva, iyo inobata maverifiers anovaka zvikonzero zvavo.