HejuruUbuyobozi bukurikira
Gukwirakwiza Leta Kurekura kuri CPU na NVMe
Tekiniki
Ubuyobozi bwa tekiniki
Lookahead na Ntare nibintu bibiri bigezweho kuri neural-net optimizme.
Umva iki gitaboAI-byavuzwe · ~2 min
Lookahead ipfunyika ibyingenzi byose hamwe nuburemere bwa 'buhoro' na 'byihuse' kugirango iterambere rirusheho gutera imbere, mugihe Intare (EvoLved Sign Momentum) yavumbuwe nubushakashatsi bwa porogaramu ya AI kandi ikavugurura uburemere ukoresheje ikimenyetso cyigihe gito - bigatuma yibuka-urumuri kandi akenshi byihuta kuruta Adamu.
Lookahead, yatanzwe na Zhang, Hinton na bagenzi be muri 2019, ikora optimizer isanzwe (nka Adam cyangwa SGD) kugirango k intambwe, hanyuma ihindure ibice bitandukanye by '' buhoro 'bipima igice cyinzira igana aho uburemere bwihuse bwarangirira. Ibi bigabanya ihungabana kandi bigabanya sensibilité kuri hyperparameter. Intare, yasohowe na Google mu 2023, yavuye mubushakashatsi bwa porogaramu yikigereranyo hejuru ya optimizer algorithms. Ikurikirana imbaraga ariko ikoresha ikimenyetso cyibikorwa mukuvugurura, buri kintu cyose rero kigenda kijyana nintambwe ihamye mu cyerekezo cyibimenyetso byegeranijwe. Intare ibika gusa buffer (igice cya leta ya Adamu, ikomeza ibiri), ikoresha kwangirika kwinshi nigipimo gito cyo kwiga, kandi yahujije cyangwa ikubita Adamu mubyerekezo binini nicyitegererezo cyururimi mugihe imyitozo yihuse kandi ihendutse.
Gupfunyika Adam hamwe na Lookahead kugirango uhagarike imyitozo ya transformateur no kugabanya imbaraga za hyperparameter.
Gukoresha Intare kugirango uhugure icyerekezo kinini (urugero, ViT) hamwe na optimizer yo hasi kuruta Adamu.
Gutegura imvugo yindimi hamwe nintare kugirango ugere kubwukuri kugereranije kugiciro cya compte.
Guhuza Lookahead na SGD mubikorwa byo kongera imbaraga-biga kugirango politiki igende neza.
Intare yakiriwe mumahugurwa menshi manini manini kuko igabanya ububiko bwa optimizer kandi irashobora kwihutisha guhuza, kandi kuvumbura kwayo kwerekana ubushakashatsi bwakozwe na 'AI-gushushanya-AI' gushakisha algorithm nkisoko nyayo yinyungu zifatika. Witege byinshi gushakisha-gukurura optimizers, gahunda ya Hybrid ihuza Lookahead-yuburyo butinda uburemere hamwe nibimenyetso bishya, hamwe no kwiyongera gushishikajwe no gukoresha neza optimizers nkuko ingano yicyitegererezo ikomeza gushimangira ingengo yimari ya GPU.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Lookahead na Ntare nibintu bibiri bigezweho kuri neural-net optimizme. Lookahead ipfunyika ibyingenzi byose hamwe nuburemere bwa 'buhoro' na 'byihuse' kugirango iterambere rihamye, mugihe Intare (EvoLved Sign Momentum) yavumbuwe nubushakashatsi bwa porogaramu ya AI kandi ikavugurura uburemere ukoresheje gusa ikimenyetso cyigihe gito - bigatuma yibuka-urumuri kandi akenshi byihuta kuruta Adamu.
Intare ikoresha ikimenyetso cyibikorwa kuri interpolated momentum term, bityo buri kintu cyose kigenda kuntambwe imwe mubyerekezo byerekana ibimenyetso.
Lookahead ikoresha byihuse imbere yimbere ya k intambwe, hanyuma yimuka buhoro buhoro igice cyinzira igana uburemere bwihuse hanyuma igasubiramo.
Intare (EvoLved Sign Momentum) yavuye mubikorwa-byo gushakisha gahunda byahindutse kandi bisuzuma gahunda yo guhitamo abakandida.
Adam akurikirana ibihe byambere nubwa kabiri; Intare ibika gusa imbaraga imwe gusa, igabanya hafi ya optimizer ya leta yibuka.
Kuva imikorere yibimenyetso ikosora ubunini bwa buri guhuza ibikorwa, intambwe ifatika ni nini, bityo igipimo gito cyo kwiga (no kugabanuka kwinshi).
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Gukwirakwiza Leta Kurekura kuri CPU na NVMe
Tekiniki