Ubuyobozi bwa tekiniki

Kuringaniza Hyperparameter

Hyperparameter nigenamiterere wahisemo mbere yimyitozo, nkigipimo cyo kwiga cyangwa ingano yicyitegererezo, icyitegererezo nticyiga wenyine.

2 min somaIbiherutse kuvugururwa

Incamake

Tuning them well is often the difference between a mediocre model and a great one.

Kwibira cyane

Ibipimo by'icyitegererezo (uburemere) byigirwa mumibare mugihe cy'amahugurwa. Hyperparameter iratandukanye: ni ipfundo washyizeho mbere igenga uko kwiga bibaho, nkigipimo cyo kwiga, ingano yicyiciro, umubare wibice, imbaraga zisanzwe, nigihe cyo kwitoza. Ntibishobora gutezimbere na gradient descente mu buryo butaziguye, bityo ushakisha indangagaciro nziza uhugura abanyamideli benshi b'abakandida no kubagereranya no kwemeza. Uburyo bworoshye cyane ni gushakisha gushakisha, kugerageza buri kintu cyose kuri gride yagenwe mbere, ariko gipima cyane. Gushakisha bisanzwe akenshi usanga igenamiterere ryiza byihuse ukoresheje icyitegererezo. Iterambere ryinshi rya Bayesian ryubaka icyitegererezo cyerekana imiterere igenamigambi kandi yibanda kubushakashatsi ahari. Igipimo cyo kwiga mubisanzwe ni hyperparameter imwe igaragara cyane kugirango ibone neza.

Ubushishozi

Kuberako hyperparameter igenzura imyitozo aho guhindurwa nayo, ufata kuringaniza nkumuzingi wo hanze uzengurutswe namahugurwa. Buri kigeragezo gihugura icyitegererezo gifite iboneza rimwe kandi kigatanga amanota kumibare yemewe. Uburyo bwa Bayesian, nkubukoresha inzira ya Gaussiya cyangwa Igiti cyubatswe na Parzen Estimators, cyerekana isano iri hagati yimiterere n amanota yo kwemeza, hanyuma hitamo igeragezwa ritaha kugirango uhuze ubushakashatsi uturere tudashidikanywaho kurwanya ikoreshwa ryiza-ryiza. Gahunda yo guhagarika hakiri kare nka Hyperband yica ibigeragezo bidakora hakiri kare kugirango ikoreshe compte aho ibara. Icy'ingenzi, ikizamini cya nyuma kigomba kuguma kidakorwa mugihe cyo guhuza amakuru kugirango wirinde kumena amakuru.

Ingaruka z'Ingamba

Igiciro na bije

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo bisobanutse

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Kugenzura ubuziranenge

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Ejo hazaza ha Hyperparameter Guhuza

Imfashanyigisho hamwe na gride ishingiye kumurongo itanga uburyo bwo kwiga imashini zikoresha (AutoML) hamwe no gushakisha ubwenge nka Bayesian optimizasiyo na Hyperband, ikoresha compte neza cyane. Mugihe icyitegererezo fatizo gikura, kongera imyitozo yuzuye kubigeragezo biba bihenze cyane, bityo rero kwitabwaho kwerekeza kuri proksi zihendutse, amategeko agenga ibipimo byerekana igenamigambi ryiza riva ku tuntu duto, no guhuza adaptate yoroheje aho kuba moderi zose. Tegereza guhuza bizagenda byikora kandi bimenyekanishe ingengo yimari, hamwe nibikoresho bigurisha ibicuruzwa byishakisha ku nyungu ziteganijwe.

Gushyira mu bikorwa Isi

Igipimo cyo kwiga cyinshi muburyo butandukanye kugirango ubone agaciro aho urusobe rwitoza byihuse nta gutandukana.

Gukoresha ubushakashatsi butunguranye kugirango uhuze ibiti byimbitse, umubare wibiti, nigipimo cyo kwiga kuri moderi-yongerera imbaraga icyitegererezo kumakuru yimbonerahamwe.

Gukoresha uburyo bwiza bwa Bayesian kugirango duhuze imbaraga zisanzwe hamwe nubunini bwurwego rwumuyoboro wimbitse kumafaranga make ya GPU.

Koresha Hyperband kugirango uhugure ibishushanyo byinshi muri make, hanyuma utange ibihe byinshi gusa kubarokotse bafite ibyiringiro.

Ingaruka & Kurinda

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Hyperparameter Tuning quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Kuringaniza neza

Ibibazo bikunze kubazwa

What is Hyperparameter Tuning?

Hyperparameter nigenamiterere wahisemo mbere yimyitozo, nkigipimo cyo kwiga cyangwa ingano yicyitegererezo, icyitegererezo nticyiga wenyine. Kubihuza neza akenshi ni itandukaniro riri hagati yicyitegererezo giciriritse nicyiza.

Niki gitandukanya hyperparameter nibintu bisanzwe byerekana urugero?

Ibiro (ibipimo) byigirwa mumibare mugihe cy'amahugurwa. Hyperparameter, nkigipimo cyo kwiga cyangwa umubare wibyiciro, byatoranijwe mbere no kugenzura uko amahugurwa agenda.

Ninde ukunze gufatwa nka hyperparameter imwe igira ingaruka nziza mukwiga byimbitse?

Igipimo cyo kwiga kigira ingaruka zikomeye niba nuburyo icyitegererezo gihinduka. Byinshi cyane kandi bitandukanya amahugurwa; hasi cyane kandi iranyerera cyangwa igahagarara.

Ni ukubera iki gushakisha bidasubirwaho gusumba grid gushakisha hyperparameter?

Grid ishakisha isesagura ibigeragezo kubipimo bidafite akamaro. Ishakisha risanzwe ryerekana umwanya neza kandi akenshi rigera muburyo bwiza hamwe nibigeragezo bike.

Nigute optimizasiyo ya Bayesian ihitamo iboneza rya hyperparameter kugirango ugerageze ubutaha?

Ibyiza bya Bayesian byerekana isano iri hagati yimiterere n'amanota yo kwemeza, hanyuma igahitamo ikigeragezo gikurikira kugirango uhuze ubushakashatsi bwakarere kataramenyekana hamwe no gukoresha utanga ibyiringiro.

Ni ukubera iki ibizamini byanyuma bigomba kuguma bidakorwa mugihe cyo guhuza hyperparameter?

Kuringaniza uhitamo igenamiterere risa neza kumakuru yose wasuzumye. Niba aricyo kizamini cyashyizweho, imikorere yawe yatangajwe. Kuringaniza ikoresha kwemeza gutandukanya aho.