Kwerekana Ururimi
Icyitegererezo cyururimi nigikorwa cyoroshye cyo guhanura ijambo cyangwa ikimenyetso kiza gikurikira, ukurikije inyandiko kugeza ubu.
Incamake
This single objective, scaled up massively, is what produces today's powerful chatbots and writing assistants.
Kwibira cyane
Muri rusange, ururimi rwicyitegererezo rutanga amahirwe yo gukurikiranya inyandiko. Urebye icyifuzo 'Umurwa mukuru wUbufaransa ni', iragereranya uburyo buri kimenyetso gishoboka gikurikira, kandi 'Paris' igomba gutsinda amanota menshi. Ururimi rwo hambere rwerekana imibare n-garama yabaruye gusa inshuro zikurikirana zamagambo, ariko barwanaga nurwego rurerure ninteruro zitagaragara. Ururimi rwa Neural rwasimbuye kubara hamwe nubushakashatsi bwize, hamwe na transformateur yubatswe kuva 2017 reka moderi zitabira kurambura inyandiko neza. Indimi nini zigezweho nkumuryango wa GPT zahuguwe kumyandiko nini corpora ifite intego imwe: guhanura ikimenyetso gikurikira. Igitangaje, gukora ibi neza bihatira icyitegererezo gukuramo ikibonezamvugo, ukuri, uburyo bwo gutekereza, nuburyo, kuko guhanura inyandiko bisaba kubyumva neza. Igisekuru gikora muburyo bwo guhanura ibimenyetso bikurikiraho no kubigaburira.
Ubushishozi
Moderi nyinshi zururimi zigezweho zirigenga: zitanga amahirwe yinteruro mubicuruzwa bikurikiraho-byerekana ibimenyetso, bihanura ikimenyetso kimwe icyarimwe ibumoso ugana iburyo. Amahugurwa agabanya igihombo cya cross-entropy, ihemba kugenera amahirwe menshi kukimenyetso gikurikiraho mumyitozo. Ibi birigenga, ibirango biva mubisobanuro ubwabyo, ntabwo rero annotation yabantu ikenewe. Mugihe cyibisekuru, ingamba zo gutoranya nkubushyuhe, top-k, na top-p (nucleus) bigenzura ubucuruzi hagati yumusaruro uteganijwe kandi uhanga.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza k'Ururimi Kwerekana
Ibizakurikiraho-ibimenyetso byagaragaye ko bifite imbaraga zitangaje, kandi amategeko yo gupima yerekana ko moderi nini namakuru menshi akomeza kunoza ubushobozi, nubwo inyungu zigenda gahoro kandi amakuru yo mu rwego rwo hejuru arimo kuba make. Imipaka igenda yerekeza kubitekerezo, birebire birebire Windows, hamwe namahugurwa nyuma yo guhugura nko kwiga gushimangira ibitekerezo byabantu bigira imyitwarire nyuma yicyitegererezo fatizo cyubatswe. Witege ko uzakomeza kuvanga imvugo yerekana ibikoresho hamwe nibikoresho, kugarura, hamwe ninyongeramusaruro nyinshi, mugihe ibyingenzi-guhanura-intego-ikurikira-intego bizakomeza kuba umusingi ibindi byose byubakiyeho.
Gushyira mu bikorwa Isi
Autocomplete muri terefone yawe ya terefone cyangwa imeri yerekana ijambo rikurikira uko wandika
Ikiganiro nka ChatGPT gitanga igisubizo cyiza muguhishurira inshuro nyinshi ikimenyetso gikurikira
Abanditsi ba code nka GitHub Copilot bahanura umurongo ukurikira wa code uhereye kumiterere
Sisitemu yo kumenyekanisha imvugo ukoresheje icyitegererezo cyururimi kugirango uhitemo inyandiko yemewe cyane muburyo busa-bwumvikana
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Language Modeling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwerekana Ururimi
Ibibazo bikunze kubazwa
What is Language Modeling?
Icyitegererezo cyururimi nigikorwa cyoroshye cyo guhanura ijambo cyangwa ikimenyetso kiza gikurikira, ukurikije inyandiko kugeza ubu. Iyi ntego imwe, yagutse cyane, niyo itanga ibiganiro bikomeye byumunsi hamwe nabafasha kwandika.
Ni ikihe gikorwa cyibanze icyitegererezo cyururimi gikora?
Ururimi rwicyitegererezo rugereranya amahirwe y'ibizakurikiraho bikurikiranye, kandi ibisekuruza bikora mukumenyesha inshuro nyinshi no gushyiramo ikimenyetso gikurikira.
Ni izihe mbogamizi nyamukuru yerekana imvugo n-garama yambere?
Moderi ya N-gram yashingiraga kubara ijambo rigufi ryikurikiranya, bityo bakemuye imiterere ndende kandi bananirwa kumagambo batigeze babona.
Kuki imyitozo yicyitegererezo yindimi yitwa 'kwiyobora'?
Ikimenyetso gikurikira gikurikira kimaze kuboneka mubyanditswe, icyitegererezo rero kirema intego zacyo nta annotasiyo yintoki.
Ni iki 'autoregressive' bisobanura ku buryo bw'ururimi?
Moderi ya Autoregressive itanga inyandiko yerekana ibimenyetso, itondekanya buri guhanura gushya kubintu byose byakozwe kugeza ubu.
Ni ubuhe buryo bwo gutakaza bukoreshwa mugutoza imvugo y'ururimi?
Amahugurwa agabanya cross-entropy, guhemba icyitegererezo cyo gutanga amahirwe menshi kukimenyetso gikurikira cyagaragaye mumyitozo.