Yawan Samfura
Misali na yau da kullun hanya ce ta tsara rubutu wacce ke ɗaukar kalma ta gaba daga alamomi waɗanda abun ciki na bayanin su ke kusa da abin mamakin ƙirar, maimakon ɗaukar mafi yuwuwar koyaushe.
Dubawa
Yana nufin fitowar da ke jin na halitta da kamannin ɗan adam ta hanyar daidaita yadda ainihin harshe ke daidaita tsinkaya da sabon abu.
Zurfafa nutsewa
Lokacin da samfurin harshe ya annabta alamar gaba, yana samar da yiwuwar rarraba akan dubban zaɓuɓɓuka. Hanyoyi masu haɗama da manyan-k suna ba da fifiko ga manyan yuwuwar alamun, wanda zai iya sa rubutu ya zama mai maimaitawa kuma mara kyau. Misali na yau da kullun, wanda Meister da abokan aiki suka gabatar a cikin 2022, yana ɗaukar wani kusurwa daban da ke tushen ka'idar bayanai. Samfurin yana ƙididdige abubuwan da ake sa ran bayanan sa (ƙirar rarrabawa). Alamu sannan ana ƙididdige su ta hanyar nisa abin mamakin nasu daga wannan tsammanin. Samfura na yau da kullun yana adana saitin alamun waɗanda abin mamaki ya fi kusa da matsakaita har sai yuwuwar yuwuwarsu ta kai ƙofa, sannan samfurori daga wannan saitin. Sakamakon rubutu ne wanda ba shi da ban tsoro ba kuma ba za a iya tsinkaya ba, yana kwatanta yadda mutane ke sadarwa ta dabi'a kusa da tsayayyen adadin bayanai.
Fahimtar Fasaha
Ga kowane ɗan takara alamar ƙirar tana ƙididdige abin mamaki, yuwuwar log mara kyau. Hakanan yana ƙididdige entropy na sharadi, matsakaicin yuwuwar-nauyin abin mamaki akan duk alamu. Misalin samfuri na yau da kullun yana da cikakken bambanci tsakanin abin mamaki da wannan entropy, sannan da zari yana ƙara alamun mafi kusa har sai yuwuwar yuwuwar su ta kai ga ma'auni tau (sau da yawa a kusa da 0.9 zuwa 0.95). Samfurin yana faruwa ne kawai a cikin wannan saiti na gida, yana murkushe manyan abubuwan da ba su da kyau da kuma mafi girman yiwuwar zaɓe.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Samfuran Na Musamman
Samfura na yau da kullun yana zama daidaitaccen zaɓi tare da top-p da top-k a cikin buɗaɗɗen ra'ayi kamar llama.cpp da Hugging Face Transformers. Yi tsammanin amfani da haɓakawa a cikin ƙirƙira rubuce-rubuce, tattaunawa, da tsarar labari inda ƙetare amintaccen ƙima yana cutar da inganci. Masu bincike suna haɗa shi tare da matakan daidaitawa waɗanda ke canzawa kowane mahallin kuma suna haɗa shi tare da maimaita hukunci. Yayin da ƙayyadaddun ƙayyadaddun bayanai ke girma, samfur na yau da kullun na iya sanar da kai tsaye, hanyoyin sanin rarrabawa waɗanda ke ja da baya saitunan zafin jiki na hannu.
Aiwatar da Gaskiyar Duniya
Ƙirƙirar almara ko waƙa inda ƙera zari ke haifar da maras ban sha'awa, maimaituwar magana da marubuta suna son ƙarin nau'ikan halitta.
Ƙaddamar da amsawar chatbot wanda ke guje wa mutum-mutumi, ƙayyadaddun jimla yayin da ake daidaitawa da kuma kan jigo.
Akwai shi azaman tuta mai yankewa (na al'ada_p) a cikin Hugging Face Transformers don masu haɓakawa suna daidaita fitowar samfurin tushen buɗe ido.
An yi amfani da shi a cikin lokutan gudu na LLM na gida kamar llama.cpp da rubutu-tsara-webui a matsayin madadin top-p don mafi arha, ƙarancin lalacewa.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Typical Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Tabbacin Samfuran Hasashen
Tambayoyin da ake yawan yi
Menene Yawan Samfura?
Misali na yau da kullun hanya ce ta tsara rubutu wacce ke ɗaukar kalma ta gaba daga alamomi waɗanda abun ciki na bayanin su ke kusa da abin mamakin ƙirar, maimakon ɗaukar mafi yuwuwar koyaushe. Yana nufin fitowar da ke jin na halitta da kamannin ɗan adam ta hanyar daidaita yadda ainihin harshe ke daidaita tsinkaya da sabon abu.
Wanne ainihin adadin samfuran samfuri na yau da kullun ya kwatanta kowane alamar ɗan takara da?
Misalin samfuri na yau da kullun yana auna nisa na kowane alamar alama daga entropy na rarrabawa, abun cikin bayanan da ake tsammani, adana alamun waɗanda abin mamaki ya fi kusa da matsakaicin.
Ta yaya samfur na yau da kullun ke bi da alamar mafi yuwuwar guda ɗaya?
Alamar yuwuwar babbar alama tana da ƙarancin ban mamaki, wanda zai iya yin nisa da matsakaicin, don haka samfuri na yau da kullun na iya barin shi daga ɗan takarar da aka saita don ƙarin alamun 'na al'ada'.
Wanne ra'ayi game da harshen ɗan adam ne ya motsa samfurin al'ada?
Hanyar ta zana kan hasashen cewa harshe na halitta yana tsayawa kusa da daidaitaccen adadin bayanai, don haka yana fifita alamun ɗaukar kusan-zuwa-matsakaici.
Menene ma'aunin tau a cikin sarrafa samfur na yau da kullun?
Tau yana saita yiwuwar tara maƙasudin; Alamu mafi kusa da entropy ana ƙara har sai yuwuwar haɗewarsu ta kai tau, yana bayyana saitin samfurin daga.
A cikin wane irin software ne samfurin samfurin da aka saba nunawa ga masu haɓakawa?
Ana aiwatar da samfur na yau da kullun azaman zaɓi na yanke hukunci (misali hankula_p) a cikin ɗakunan karatu kamar Hugging Face Transformers da lokutan aiki na gida kamar llama.cpp.