Icyitegererezo
Ubwoko bw'icyitegererezo ni uburyo bwo kwandika inyandiko itoranya ijambo rikurikira uhereye ku bimenyetso birimo amakuru yicaye hafi yicyitegererezo cyateganijwe, aho guhora ufata ibishoboka cyane.
Incamake
It aims for output that feels natural and human-like by matching how real language balances predictability and novelty.
Kwibira cyane
Iyo ururimi rwicyitegererezo ruvuga ibimenyetso bizakurikiraho, rutanga amahirwe yo gukwirakwiza ibihumbi byinshi. Umururumba na top-k uburyo bushigikira ibimenyetso byinshi-byerekana ibimenyetso, bishobora gutuma inyandiko isubiramo kandi bland. Icyitegererezo gisanzwe, cyatangijwe na Meister na bagenzi be mu 2022, gifata indi mpande yashinze imizi mubitekerezo byamakuru. Icyitegererezo kibara amakuru ateganijwe (entropy yo kugabura). Tokens noneho itangwa nuburyo intera yabo itunguranye yicaye kubyo biteze. Icyitegererezo gisanzwe gikomeza urutonde rwibimenyetso bitunguranye byegereye ikigereranyo kugeza igihe ibyo bahuriyemo bigera ku mbibi, hanyuma ingero ziva kuri iyo seti. Igisubizo ni inyandiko idatunguranye cyangwa ngo ihanurwe kimwe, yerekana uburyo abantu basanzwe bavugana hafi yikigereranyo gihamye.
Ubushishozi
Kuri buri mukandida ikimenyetso cyerekana icyitegererezo gitunguranye, log-bishoboka. Irabara kandi entropiya isabwa, impuzandengo-uburemere buringaniye butunguranye hejuru yikimenyetso cyose. Ubwoko bw'icyitegererezo butondekanya ibimenyetso byerekana itandukaniro ryuzuye hagati yabo itunguranye na entropiya, hanyuma umururumba ukongeramo ibimenyetso byegereye kugeza igihe amahirwe yabo yo guhuriza hamwe akubita ibipimo tau (akenshi hafi 0.9 kugeza 0.95). Gutoranya bibaho gusa muribi bisanzwe bisanzwe, guhagarika byombi bikabije hamwe nibishobora kuba byoroshye.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'icyitegererezo gisanzwe
Icyitegererezo gisanzwe kirimo guhinduka muburyo busanzwe hamwe na top-p na top-k mumasoko afunguye yerekana ibintu nka llama.cpp na Hugging Face Transformers. Witegereze gukoreshwa gukoreshwa mukwandika guhanga, ibiganiro, no kubyara inkuru aho decoding ifite umutekano muke ibabaza ubuziranenge. Abashakashatsi barimo kuyihuza n'inzitizi zijyanye n'imihindagurikire y'ikirere ihinduka kuri buri murongo kandi ikabihuza n'ibihano byo gusubiramo. Nkamakuru-theoretike decoding ikuze, mubisanzwe icyitegererezo gishobora kumenyesha uburyo bwikora, gukwirakwiza-kumenya uburyo busa nubushyuhe bwubushyuhe.
Gushyira mu bikorwa Isi
Kubyara ibihimbano cyangwa imivugo aho decoding yerekana umururumba itanga imvugo ituje, isubiramo kandi abanditsi bifuza ubwoko butandukanye.
Imbaraga za chatbot zisubiza zirinda robotic, interuro formulaire mugihe ugumye hamwe kandi kumutwe.
Kuboneka nkibendera rya decoding (bisanzwe_p) muri Hugging Face Transformers kubateza imbere bahuza isoko-yisoko yicyitegererezo.
Byakoreshejwe mubikorwa bya LLM byaho nka llama.cpp hamwe ninyandiko-ibisekuruza-webui nkuburyo bwo hejuru-p kubwandiko bukize, butangirika.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Typical Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kugenzura Icyitegererezo
Ibibazo bikunze kubazwa
What is Typical Sampling?
Ubwoko bw'icyitegererezo ni uburyo bwo kwandika inyandiko itoranya ijambo rikurikira uhereye ku bimenyetso birimo amakuru yicaye hafi yicyitegererezo cyateganijwe, aho guhora ufata ibishoboka cyane. Igamije gusohora ibyiyumvo bisanzwe kandi bisa nabantu muguhuza uburyo ururimi nyarwo ruringaniza ibiteganijwe nudushya.
Ni ubuhe bwoko bwibanze bugereranya buri mukandida ikimenyetso kirwanya?
Ubwoko bw'icyitegererezo gipima intera buri kimenyetso gitangaje kiri hagati yikwirakwizwa rya entropiya, amakuru ateganijwe, kubika ibimenyetso bitunguranye byegeranye nicyo kigereranyo.
Nigute icyitegererezo gisanzwe gifata ikimenyetso kimwe gishoboka cyane?
Ikimenyetso kinini cyane gishobora kuba gitangaje cyane, gishobora kuba kure yikigereranyo, bityo icyitegererezo gishobora gusigara hanze yumukandida washyizeho ibimenyetso byinshi 'bisanzwe'.
Icyitegererezo gisanzwe cyatewe niki gitekerezo kijyanye nururimi rwabantu?
Uburyo bushingiye kuri hypothesis ko ururimi karemano ruguma hafi yikigereranyo kimwe cyamakuru, bityo rukaba rutanga ibimenyetso bitwara hafi-ugereranije bitunguranye.
Niki ibipimo bya tau mubisanzwe bigenzura?
Tau ashyiraho intego yo guhuriza hamwe; ibimenyetso byegereye entropy byongeweho kugeza igihe ibishoboka byose hamwe bigera kuri tau, bisobanura ibyashizweho kugirango bitangwe.
Ni ubuhe bwoko bwa software isanzwe ikunze kugaragara kubateza imbere?
Icyitegererezo gisanzwe gishyirwa mubikorwa nkuburyo bwa decoding (urugero bisanzwe_p) mumasomero nka Hugging Face Transformers hamwe nigihe cyogukora nka llama.cpp.