Guhatira abarimu muburyo bukurikiranye
Guhatira abarimu ni amayeri yo guhugura kuri moderi zikurikirana aho ikimenyetso cyukuri cyabanjirije iki, ntabwo ari icyitegererezo ubwacyo, kigaburirwa nkibikurikira byinjira.
Incamake
It makes training fast and stable.
Kwibira cyane
Moderi ikurikirana nka RNNs, LSTMs, na decoder ya Transformer itanga ikimenyetso kimwe icyarimwe, hamwe na buri ntambwe itondekanya ibimenyetso mbere yacyo. Mugihe cy'amahugurwa urashobora kugaburira icyitegererezo ibyo wavuze mbere, ariko hakiri kare mugutoza ibyo bihanura usanga ahanini ari bibi, kubwibyo amakosa arikomatanya no kwiga gukurura. Guhatira mwarimu ahubwo kugaburira ubutaka-ukuri kuva kumurongo ukurikirana kuri buri ntambwe, bityo icyitegererezo gihora kimeze neza mbere. Ibi bituma imyanya yose ihugurwa muburyo bubangikanye (cyane cyane muri Transformers ikoresheje maskike yo kwiyitaho) kandi itanga imbaraga zikomeye, zihamye. Gufata: mugihe cyo gufata umwanzuro nta kuri kwukuri guhari, bityo icyitegererezo kigomba kurya ibisubizo byacyo, bigakora ibizamini bya gari ya moshi bitajyanye no kubogama.
Ubushishozi
Hamwe nabarimu bahatira, decoder yinjiza kumurongo t ni ikimenyetso cya zahabu y_ {t-1}, mugihe igihombo ari cross-entropy hagati yikwirakwizwa ryikitegererezo na y_t. Muri Transformers, impanvu yo kwitondera mask ireka intego zose zikurikirana zitunganyirizwa mumurongo umwe wimbere mugihe ukomeje kubuza buri mwanya gushakisha ibimenyetso bizaza. Uku kubangikanya nimpamvu nyamukuru Abahinduzi bitoza byihuse kuruta intambwe-ku-ntambwe isubiramo decoding.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'abarimu bahatira muburyo bukurikiranye
Guhatira abarimu bizakomeza kuba urufatiro rwo guhugura imvugo yindimi zidasanzwe kubera umuvuduko wacyo, ariko ubushakashatsi buragenda buhuza nubundi buryo. Gahunda ziteganijwe, intego-urwego rwintego, kwigira gushimangira ibitekerezo byabantu, hamwe na decoders idafite autoregressive byose bigamije kugabanya itandukaniro-kubogama. Tegereza integanyanyigisho za Hybrid zitangirana numwarimu wuzuye uhatira kandi buhoro buhoro ugaragaza icyitegererezo kubisekuru byabo uko bikura.
Gushyira mu bikorwa Isi
Guhugura imashini isobanura imashini yerekana aho zahabu igenewe interuro igaburirwa token-to-token to decoder
Gutegura imiterere-yindimi ya GPT hamwe na masking masking kuburyo buri gikurikira-kimenyetso gihanura kibona ukuri kwambere.
Guhugura ishusho-yerekana decoder mugaburira amagambo yanditseho amagambo mugihe cyo kwiga
Kwigisha imvugo-ku-cyitegererezo aho inyuguti-yukuri inyuguti zinyandiko ziyobora decoder kuri buri ntambwe
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Teacher Forcing in Sequence Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Urutonde-Kuri-Urutonde
Ibibazo bikunze kubazwa
What is Teacher Forcing in Sequence Models?
Guhatira abarimu ni amayeri yo guhugura kuri moderi zikurikirana aho ikimenyetso cyukuri cyabanjirije iki, ntabwo ari icyitegererezo ubwacyo, kigaburirwa nkibikurikira byinjira. Bituma imyitozo yihuta kandi ihamye.
Mugihe cyo guhatira abarimu, niki kigaburirwa nkigitekerezo kuri buri ntambwe ya decoding?
Guhatira mwarimu kugaburira ibimenyetso byukuri intego yibanze aho guhanura icyitegererezo, kugumya gutondekanya neza.
Ni izihe nyungu nyamukuru zo guhatira abarimu mugihe cy'amahugurwa?
Kuberako icyitegererezo gihora gisabwa kubisobanuro byukuri, gradients zirakomeye kandi imyitozo ihuza byihuse kandi bihamye.
Muri decoder ya Transformer, ni ubuhe buryo butuma amahugurwa ahatirwa na mwarimu akora mu buryo bumwe?
Mask itera kubuza buri mwanya kwitabira ibimenyetso bizaza, bityo urutonde rwose rushobora gutunganyirizwa icyarimwe nta gushuka.
Mugihe cyo gufata umwanzuro, kuki bidashoboka gukoreshwa mwarimu?
Mugihe cyibisekuru nyabyo nta rutonde rukurikirana rubaho, icyitegererezo rero kigomba kugaburira ibyo wavuze mbere, bitandukanye no mumahugurwa.
Ni ikihe gihombo gikoreshwa muri buri ntambwe mugihe cyo guhugura abarimu?
Moderi ya Autoregressive yatojwe hamwe na token-urwego rwambukiranya-entropy ugereranije igabanywa ryahanuwe na zahabu ikurikira.