Gukusanya Uburyo hamwe no Kuzamura Gradient
Uburyo bwa Ensemble buhuza moderi nyinshi zoroshye kuburyo itsinda ritanga ubuhanuzi bwiza kuruta icyitegererezo kimwe.
Incamake
Gradient boosting is the most powerful of these — it builds trees one at a time, each correcting the errors of the last, and dominates real-world tabular machine learning.
Kwibira cyane
Ensemble iruhukira kubitekerezo byoroshye: abiga benshi bafite intege nke, bahujwe, barashobora gukora igitekerezo gikomeye. Imiryango ibiri irayobora. Gupakira (urugero, Amashyamba asanzwe) atoza ibiti byinshi muburyo bubangikanye kandi bigereranijwe, bigabanya cyane cyane itandukaniro. Gutezimbere imyitozo ikurikirana, buriwese yibanda kumakosa yabanjirije ayakozwe, bigabanya cyane kubogama. Gradient kuzamura ama frame buri giti gishya nkintambwe ihuye na gradient mbi - amakosa asigaye - yimikorere yo gutakaza kugeza ubu. Amasomero nka XGBoost, LightGBM, na CatBoost yongeramo ibisanzwe, kugabana ubwenge, hamwe nubuhanga bwihuse. Ku miterere / imbonerahamwe yamakuru - gutahura uburiganya, ibiciro, urutonde - ubu buryo busanzwe butsinda imyigire yimbitse kandi bugatsinda amarushanwa menshi ya Kaggle.
Ubushishozi
Mu kuzamura gahoro gahoro, utangirana nubuhanuzi buteye isoni hanyuma ukongeraho inshuro nyinshi igiti gito gihuye nibisigara - igipimo cyigihombo kubijyanye nubuhanuzi bwa none. Umusanzu wa buri giti wagabanijwe nigipimo cyo kwiga (shrinkage), kuburyo icyitegererezo gitera imbere muntambwe nto. Kuberako amakosa yiyongereye niba urenze, usanzwe (imipaka yuburebure bwibiti, kugabanya umurongo nibiranga, ibihano L1 / L2 kuburemere bwibabi) nibyingenzi kugirango itsinda ridafata mu mutwe urusaku.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza k'uburyo bwa Ensemble hamwe na Gradient Boosting
Ibiti byongerewe imbaraga ibiti bikomeza kuba bisanzwe kubisobanuro byimbonerahamwe kandi nta kimenyetso cyerekana ko yimitswe hariya, nubwo imyigire yimbitse itera imbere ahandi. Witege ko uzakomeza kunguka mumuvuduko no kwihuta kwa GPU, gukoresha neza kavukire yamakuru yihariye kandi yabuze, hamwe no kurushaho guhuza imashini yiga imashini (AutoML). Ubushakashatsi bwo guhuza imbaraga hamwe nu miyoboro yimitsi, no muburyo bwihuse, busobanurwa neza, burakora. Kubimenyereza, kuzamura amasomero bizakomeza kuguma byizewe, byukuri-guhitamo kwambere kubibazo byurupapuro.
Gushyira mu bikorwa Isi
Amabanki hamwe nabatunganya ubwishyu bakoresheje XGBoost kugirango bamenyekanishe ibikorwa byuburiganya bivuye kumiterere nkumubare, ahantu, nigihe.
Shakisha moteri hamwe nububiko bwa interineti urutonde rwibisubizo hamwe na moderi-yongerewe imbaraga 'kwiga-kurwego'.
Ubwishingizi nogutanga ibigo byerekana ingaruka no gushyiraho ibiciro uhereye kumibare yabakiriya.
Abanywanyi ba Kaggle batsinze amarushanwa ya tabula-data mukusanya moderi ya LightGBM na CatBoost hamwe.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Ensemble Methods na Gradient Boosting ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Ensemble Methods and Gradient Boosting quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Stochastic Gradient Kumanuka hamwe na Momentum
Ibibazo bikunze kubazwa
What is Ensemble Methods and Gradient Boosting?
Uburyo bwa Ensemble buhuza moderi nyinshi zoroshye kuburyo itsinda ritanga ubuhanuzi bwiza kuruta icyitegererezo kimwe. Kuzamura buhoro buhoro nimbaraga zikomeye muribi - yubaka ibiti icyarimwe, buri kimwe gikosora amakosa yanyuma, kandi kiganje kwisi-nyigisho yimashini.
Ni ikihe gitekerezo cyibanze inyuma yuburyo bukoreshwa?
Amatsinda akusanya ibyahanuwe kuri moderi nyinshi, bityo ibisohokayandikiro byabo hamwe birasobanutse neza kandi bikomeye kuruta abanyamuryango kugiti cyabo.
Nigute kuzamura buhoro buhoro gutandukana no guterura (urugero, Amashyamba asanzwe)?
Gupakira byubaka moderi yigenga muburyo bubangikanye kandi ikagereranya (kugabanya ibitandukanye), mugihe kuzamura byubaka icyitegererezo kimwekindi, buri kimwe gikosora amakosa yanyuma (kugabanya kubogama).
Kuzamura buhoro buhoro, buri giti gishya gikwiranye niki?
Buri giti gihuye na gradient itari nziza yigihombo - mubyukuri amakosa asigaye - bityo ukongeraho ugahanura guhanura kugiciro cyiza.
Niyihe ntego yo kwiga (shrinkage) mukuzamura?
Igipimo gito cyo kwiga kigabanya ivugurura rya buri giti, bitezimbere muri rusange mugiciro cyo gukenera ibiti byinshi.
Ni ubuhe bwoko bw'amakuru aribiti byongerewe ibiti cyane cyane byiganje kuri?
Amasomero nka XGBoost na LightGBM ahora yitwara neza mumibare yamakuru kandi atsindira amarushanwa menshi ya Kaggle.