HejuruUbuyobozi bukurikira
Gukwirakwiza Politiki Yerekeye Amatsinda
Tekiniki
Ubuyobozi bwa tekiniki
Icyiciro cya kabiri cyo gutezimbere gikoresha amakuru yagoramye (matrike ya Hessian ya kabiri ikomoka) kugirango itere intambwe nziza igana byibuze, ntabwo ihanamye.
Umva iki gitaboAI-byavuzwe · ~2 min
Ishobora guhurira mu mibare mike cyane y'ubusubiramo ugereranyije n'uburyo busanzwe bwa gradient descent, ariko ikiguzi cyo kubara curvature gituma bigora kuyagura.
Gradient descente izi gusa ahahanamye kurubu, bityo itoranya intambwe ihamye cyangwa intoki zingana nintambwe kandi yizeye ibyiza. Uburyo bwa Newton burakomeza: burareba kandi uburyo umusozi uhinduka (kugabanuka), wafashwe na Hessian, matrix yibikomoka ku gice cya kabiri cyose. Ivugurura rigwiza Hessian ihindagurika na gradient, ihita ikuraho buri cyerekezo ikamanuka hafi yuburinganire bwa hafi ya quadratic. Kubakure ya quadratique neza, uburyo bwa Newton bugera hepfo murwego rumwe. Gufata ni ubugome: icyitegererezo gifite ibipimo bya N gifite N-by-N Hessian, kubika no guhinduranya bisaba hafi ububiko bwa N-kare na compte ya N-cubed. Kuri miliyari-ibipimo byimikorere bidashoboka, niyo mpamvu abimenyereza bakoresha ibigereranyo bihendutse.
L-BFGS ikwiranye no gusubira inyuma hamwe nizindi moderi za convex muri scikit-wige, aho ikunze gukubita hasi ya gradient kumanuka kuri dataseti nto kandi ziciriritse
Guhindura bundle mukubaka 3D hamwe na SLAM, aho Gauss-Newton na Levenberg-Marquardt batunganya kamera yerekana imyanya.
Guhugura utuntu duto twa fiziki-yamenyeshejwe imiyoboro yimitsi aho L-BFGS igera kubintu byukuri Adamu arwanira kugera
Shampoo na K-FAC byihutisha amahugurwa manini yo kwiga yimbitse ugereranije imiterere ya Hessian
Kumiyoboro nini nini, uburyo bwa kabiri-butondekanya uburyo bukomeza kuba budasanzwe, ariko ibigereranyo bigenda byiyongera. Optimizers nka K-FAC na Shampoo igereranije igoramye ukoresheje blok-diagonal cyangwa Kronecker-yubatswe, hamwe nuburyo bushya nka Sophia na Muon bakoresha igereranya rihendutse kugirango bagabanye umuvuduko munini wururimi. Tegereza imbaraga zogukomeza gufata ibimenyetso byingirakamaro mugihe cyegereye-cyambere cyateganijwe, kugabanya itandukaniro riri hagati ya Adam nintambwe nyayo ya Newton.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Icyiciro cya kabiri cyo gutezimbere gikoresha amakuru yagoramye (matrike ya Hessian ya kabiri ikomoka) kugirango itere intambwe nziza igana byibuze, ntabwo ihanamye. Irashobora guhurira muburyo butangaje cyane kuruta kugabanuka kumanuka, ariko ikiguzi cyo kubara kugabanuka bituma bigora gupima.
Uburyo bwa Newton bwongerera icyiciro hamwe na curvature kuva Hessian, ikareka ikuraho icyerekezo kandi igereranya byibuze kwadratike yaho.
Kuri kwadratike nyayo, moderi ya quadratic yaho ihwanye numurimo wukuri, nuko intambwe imwe ya Newton isimbuka igana byibuze.
Hamwe na N ibipimo Hessian ifite N-kwaduka ibyinjira no kuyihindura umunzani nka N-cubed, bikaba bidashoboka kuri miliyari y'ibipimo.
BFGS ivugurura byimazeyo igereranya rya Hessian ihindagurika ukoresheje impinduka muri gradient hagati yintambwe, wirinda kubara bitaziguye.
L
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Gukwirakwiza Politiki Yerekeye Amatsinda
Tekiniki