HejuruUbuyobozi bukurikira
Using AI to Work Through Physics Problems
Porogaramu
Ubuyobozi bwa tekiniki
Igororotse-Binyuze mu Kugereranya (STE) ni amayeri yoroshye yo guhugura imiyoboro ikubiyemo intambwe zikomeye, zidatandukanye nko kuzenguruka cyangwa kurenga.
Umva iki gitaboAI-byavuzwe · ~2 min
Ikoresha agaciro keza kuri pass yimbere ariko yitwaza ko ibikorwa byari indangamuntu mugihe cyo kubara gradients.
Ibikorwa bimwe, nko kuzenguruka kuri integer, binini yerekana uburemere kugeza kuri + 1 / -1, cyangwa gutoranya icyiciro cyo hejuru hamwe na argmax, bifite inkomoko ya zeru hafi ya hose kandi idasobanuwe neza. Iyo zero gradient ihagarika kwiga imbeho. Igororotse-Binyuze muri Estimator kuruhande ibi mugukuramo inzira zinyuma ninyuma: imbere, ikoresha ibikorwa byukuri; gusubira inyuma, ikoporora gusa ibyinjira byinjira byanyuze nkaho ibikorwa byabaye indangamuntu (cyangwa proksi yoroshye). Ikigereranyo kibogamye, kubera ko igipimo nyacyo rwose ari zeru, nyamara mubikorwa iyi 'kwigira ko yoroshye' igereranya gari ya moshi igereranya kandi igereranya imiyoboro idasanzwe, niyo mpamvu STE ari urugo rwakazi rwo kwiga byimbitse.
Guhugura binary na bike-bitondekanya imiyoboro ya neural kugirango isuzume neza kuri terefone nibikoresho byo ku nkombe.
Gusubira inyuma ukoresheje codebook ya discret reba muri VQ-VAE hamwe na neural amajwi / amashusho yerekana ibimenyetso.
Kwimenyekanisha-Kwimenyereza aho uburemere cyangwa ibikorwa byegeranijwe kugeza kuri point-point mugihe cyimbere.
Kwiga kwitonda cyane cyangwa gutandukanya amarembo aho argmax cyangwa imbago yicaye muburyo bwo kubara.
STE ishimangira kwiyongera mumashanyarazi mato mato na binary bikurikirana kubikoresho na AI bitagabanije ingufu, kandi nibyingenzi muguhugura moderi zingana na vector nkizikoreshwa mumashusho agezweho hamwe na tokenizer. Imirimo ikomeje irashaka kugereranya, kutabogamye kubigereranyo no gusobanukirwa neza nimpamvu igereranya rito rikora. Nkuko bikenewe kubintu bito, byihuse, byuzuye bigenda byiyongera kuri terefone hamwe nibikoresho bigezweho, tegereza amayeri yuburyo bwa STE azakomeza kuba urufatiro nubwo bizwi kubogama.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Igororotse-Binyuze mu Kugereranya (STE) ni amayeri yoroshye yo guhugura imiyoboro ikubiyemo intambwe zikomeye, zidatandukanye nko kuzenguruka cyangwa kurenga. Ikoresha agaciro keza kuri pass yimbere ariko yitwaza ko imikorere yari indangamuntu mugihe ibara gradients.
The guide describes a hard forward pass and a surrogate backward pass.
The guide says hard rounding has a zero or undefined derivative that can stop learning.
The guide explicitly notes that the approximation is biased.
The guide names quantization and rounding as common applications.
The guide gives this pattern to preserve the hard value while passing the identity gradient.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Using AI to Work Through Physics Problems
Porogaramu