Wàccig degrade
Wàcci gradient mooy anam wi gëna xéewale biy toxal diisaayu model bi wàcci jëm ci njuumte bu gëna ndaw, benn jéego bu ndaw benn yoon.
Résumé
It is how learning happens once backpropagation has computed the gradients.
Plongeur bu xóot
Xalaatal sudoon danga taxaw ci kaw tundu wu bari lay di jéema yegg ci suufu vale bi fekk yaa ngi yëg pente bi ci suufu say tànk. Wàcci degrade dafay def loolu gën ci paysage erreur model bi. Gradient bi dafay wane wàll wi gëna gaaw ci yokkute ci ñàkk, kon algorithm bi dafay jéego ci wàll wi ko jàkkarloo ngir wàññi njuumte bi. Dayo jéego bu nekk mingi aju ci ni ñuy jàngee, muy hyperparametre bu am solo: dafa yaatu lool te model bi dafay romb ba noppi di wuute, mu ndaw lool te dafay raam di tàggat. Ci jëf, model yi bari wuñu luñuy jëfandikoo done yépp ci jéego bu nekk. Descendant gradient stochastic (SGD) ak xeetu lote yu ndaw yi dañuy xayma gradient bi ci misaal yu ndaw yu bari, loolu mooy tax tàggat bi gaaw, ba noppi jàppale model bi mu rëcci ci fiir yu xóotul yi ci kaw suuf si ñàkk.
Gis-gis xarala
Coppite bu nekk dafay topp sàrt bu yomb: poid bu bees bi mingi méngoo ak poid bu yàgg bi dindi tolluwaayu jàng bi yokk ko ci gradient bi. Descendant gradient bu ndaw dafay xayma gradient bi ci kaw benn subset bu ndaw ci done yi du ci ensemble bi yépp, di jaay njubte gi gëna jubal ci gaawaay ak bruit bu am njariñ. Optimizer yu bees yu melni Adam tabax ci kaw lii ci méngale tolluwaayu jàng bu baax ci parametre bu nekk ak yokk momentum, biy dajale gradient yu weesu ngir nooy oscillations ak gaawlu yokkute ci gox yu plat wala yu am formu ravine ci paysage perte.
njeextalu pexe
dogal yu gëna leer
Daf lay jàppale nga tàqale kàddu yu leer ci wàllu xarala ak làkku fësal njaay.
Njëgg ak budget
Mën nga laaj laaj yu gëna baax ci samp gi balaa ngay dugal xaalis wala sa jotu liggéey.
Ekip ak def liggéey
Ekip yi bokk xam-xam ñoo gëna mëna jël yenn dogal ci wàllu produit, politik ak jàng.
Ëlëgu wàccinu gradient
Descendant gradient plain bariwul luñu koy jëfandikoo kese tay; optimisatër yu melni Adam ak AdamW ñoo ëpp doole ci tàggat yaram. Gëstu baa ngi wéy ci wàllu njàng-taux oraire, pexe tàngoor, ak ñaareelu pexe jëfandikoo xibaar courbure ngir gëna gaaw ci convergence. Lu model yi di màgg, wàcci gradient buñ séddale ak buñ xaaj ci ay junni GPU dafay nekk lu am solo, te pexe yi ngir dakkal coppite yu mag yooyu dañu nekk frontiere buy dox. Xalaat bi gëna am solo, topp gradient bu baaxul bi, dina wéy, waaye masin bi wër jéego yi dafay wéy di jëm kanam.
Doxal ci àdduna dëgg
Wàññi njuumti yi ci misaalu làkk ci ay miliyaar ci jeton tàggat yaram yu jëfandikoo yeesali lote yu ndaw
Tuning tolluwaayu jàng suko defee ab modelu nataal di daje ci lu gaaw te perte bi du jameet
Jëfandikoo momentum ngir gaawlu tàggat reso buy xàmmee kàddu yi tëju ci vale bu gudd te sew
Jëfandikoo Adam ngir gëna suqali benn model ci kaw benn done bu ndaw, fu tolluwaayu jàng bu nekk ci parametre di jàppale stabilite
Risk yi ak balustrade yi
Ekip yu bari mën nañu jëfandikoo benn baat ci anam wu wuute, kon teela leeral yaatuwaayam.
Benchmark yi mën nañu nuru lu am doole waaye performance yi ci àdduna bi duñu tolloo.
Bëgg kalite done ak palaŋu jàngat dafay faral di jur njariñ yu yomba dagg.
Roadmap ngir samp gi
Tàmbaleel ci joxe leeral ci làkk wu leer ci njariñ li nga soxla.
Tannal benn metric bu baax ak benn anam bu baaxul balaa ngay saytu.
Doxal ab pilote bu ndaw ak ay done yu representatif, du ab demo bu leer.
Bindal fi Gradient Descent di jàppale ak fi pexe yu gëna yomba gëna baax.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Gradient Descent quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Wàcci degrade stokastik ak saa
Laaj yi ñuy faral di laaj
What is Gradient Descent?
Wàcci gradient mooy anam wi gëna xéewale biy toxal diisaayu model bi wàcci jëm ci njuumte bu gëna ndaw, benn jéego bu ndaw benn yoon. Noonu la jàng bi di demee ginaaw bi backpropagation xaymaa gradient yi.
Ci ban wàll la wàccinu gradient bi di toxal diisaay yi?
Degrade bi dafay wane yokkute bu gëna kawe ci ñàkk, suko defee ngir wàññi ñàkk, algorithm bi dafay jéego ci wàll wi ko jàpp (négatif).
Lan mooy saytu tolluwaayu jàng bi?
Tolluwaayu jàng bi dafay wane ba fu poid yi di dem ci yeesal bu nekk; overshoots yu rëy lool, yu ndaw lool taxna tàggat yaram di yeex.
Lan moo wuutale wàccinu gradient stochastic wala mini-batch ak jëfandikoo done yépp?
Wàcci gradient bu ndaw ak stochastic dañuy jege gradient bi ci jëfandikoo misaal yu ndaw, loolu mooy gaawal tàggat yaram ba noppi yokk bruit bu am njariñ.
Lan mooy jafe-jafe bi nit ñi di jàng bu bari lool mëna jur?
Jéego yu rëy mën nañu tëb dem ba weesu li gëna ndaw ba noppi rebondir wala ñu kalaate, loolu mooy waral ñàkk gi di gëna yokk moo gën ñu dakkal.
Lan la momentum bi di yokk ci wàccinu gradient bi?
Momentum dafay yor ab moyenne buy daw ci degrade yi weesu, di jàppale optimisatër bi mu gëna gaaw ci biir ravin yi ak dakkal oscillations yi.