Hoos-u-dhac
Hoos-u-dhaca gradient waa habka wanaajinta ee dhab ahaantii u dhaqaajiya miisaanka moodeelka hoos u socda khalad hoose, hal tallaabo oo yar markiiba.
Dulmar
It is how learning happens once backpropagation has computed the gradients.
quusid qoto dheer
Bal qiyaas adigoo dul taagan buur ciiryaamo badan oo isku dayaya in aad gaadho sagxada dooxa adiga oo kaliya dareemaya jiirada cagahaaga hoostooda. Soo degista gradient waxay si sax ah tan u sameeysaa muuqaalka qaladka moodeelka. Dhibcaha jaangooyooyinka ee jihada korodhka ugu hooseeya ee khasaaraha, markaa algorithm waxay u socotaa jihada ka soo horjeeda si loo yareeyo qaladka. Cabbirka tillaabo kasta waxaa lagu xakameynayaa heerka barashada, cabirka sare ee muhiimka ah: aad u weyn iyo moodeelku wuu batay oo kala leexdaa, aad u yar iyo gurguurta tababarka. Ficil ahaan, moodooyinka si dhif ah ayey u isticmaalaan xogta xogta oo buuxda tillaabo kasta. Kala duwanaanshaha dufcada yar-yar ee Stochastic gradient (SGD) waxay ku qiyaasaan jaangooyooyinka shaybaarada randomka yar, samaynta tababarka degdega ah iyo caawinta moodelku inuu ka baxsado dabinada gacmeed ee dusha lumin.
Aragtida Farsamada
Cusbooneysii kastaa wuxuu raacayaa sharci fudud: miisaanka cusub wuxuu la mid yahay miisaankii hore oo laga jaray heerka waxbarashada waqtiyada gradient-ka. Dufcadda-yar-yar waxay ku xisaabtamaysaa xog-hoosaad yar halkii ay ka ahaan lahayd xogta oo dhan, ka ganacsiga saxnaanta saxda ah ee xawaaraha iyo dhawaaqa waxtarka leh. Hagaajinta casriga ah sida Adam waxay ku dhistaan tan iyagoo la qabsanaya heerka waxbarasho ee wax ku oolka ah ee halbeeg kasta oo ku dara dardar, kaas oo ururinaya gradients hore si ay u fududeeyaan jahawareerka iyo dardargelinta horumarka iyada oo loo marayo gobollada siman ama qaab-hoosaadka dooxa ee muuqaalka khasaaraha.
Saamaynta Istiraatijiyadeed
Go'aamo cad
Waxay kaa caawinaysaa inaad kala saartid sheegashooyinka farsamada cad iyo luqadda suuq-geynta.
Qiimaha iyo miisaaniyada
Waxaad waydiin kartaa su'aalo fulineed oo wanaagsan ka hor inta aadan lacag ama waqti bixin.
Kooxda iyo socodka shaqada
Kooxaha fahamka la wadaago waxay sameeyaan wax soo saar, siyaasad, iyo go'aano waxbarasho oo wanaagsan.
Mustaqbalka Hoos-u-dhaca Gradient
Hoos-u-dhac cad ayaa maanta si dhif ah loo isticmaalo kaligiis; Hagaajinta la qabsiga sida Adam iyo AdamW ayaa xukuma tababarka baaxadda leh. Cilmi-baadhistu waxay ku sii socotaa jadwallada heerka-wax-barashada, istaraatiijiyadaha kululaynta, iyo hababka-labaad ee isticmaala macluumaadka curvature si degdeg ah isu-gudbid. Sida moodooyinka u koraan, qaybsan iyo hoos u firdhisan ee kumanaan GPU-yada ayaa noqda lama huraan, iyo farsamooyinka lagu dejiyo cusboonaysiintan ballaadhan waa xuduud firfircoon. Fikradda udub-dhexaadka ah, raac jaangooyooyinka taban, way sii jiri doontaa, laakiin mashiinada ku wareegsan cabbirida tallabada ayaa sii kordheysa.
Dhaqangelinta Adduunka-dhabta ah
Hoos u dhigista khaladka saadaasha qaabka luqadda balaayiin calaamado tababar ah iyadoo la isticmaalayo cusboonaysiinta dufcada yar
Hagaajinta heerka waxbarashada si qaabka sawirku si dhakhso leh isugu keeno iyada oo aan khasaaruhu qarxin
Isticmaalka dardargelinta si loo dedejiyo tababbarka shabakada aqoonsiga hadalka oo ku dheggan dooxada dheer ee khasaaraha dhuuban
Codsashada Aadam si uu u hagaajiyo moodal ku saabsan xog-ururin yar halkaas oo heerarka waxbarashada halbeeggu ay caawiso xasilloonida
Khatarta & Dariiqyada Ilaalada
Kooxo kala duwan ayaa laga yaabaa inay isla erey u isticmaalaan si kala duwan, marka hore u qeex baaxadda.
Tilmaamaha ayaa u ekaan kara kuwo xooggan halka waxqabadka dhabta ah ee dunidu aanu sinnayn.
In la iska indho tiro tayada xogta iyo qorshayaasha qiimayntu waxay inta badan abuurtaa natiijooyin jilicsan.
Qorshe Hawleedka Dhaqangelinta
Ka bilow qeexidda luqadda cad ee natiijada aad u baahan tahay.
Dooro hal cabbir guusha iyo hal xaalad guuldarro ka hor tijaabada.
Ku orod duuliye yar oo wata xogta matale, ee ma aha bandhig muuqaal ah.
Dukumeenti meesha Gradient Deescent caawinayo iyo halka hababka fudud ay ka fiican yihiin.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Gradient Descent quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Hoos-u-dhaca Stochastic Gradient oo leh Momentum
Su'aalaha soo noqnoqda
What is Gradient Descent?
Hoos-u-dhaca gradient waa habka wanaajinta ee dhab ahaantii u dhaqaajiya miisaanka moodeelka hoos u socda khalad hoose, hal tallaabo oo yar markiiba. Waa sida ay waxbarashadu u dhacdo marka dib-u-faafintu ay xisaabiso jaangooyooyinka.
Jihogee buu ka soo degi karaa miisaanka?
Dareenku wuxuu tilmaamayaa kororka ugu hooseeya ee khasaaraha, si loo yareeyo khasaaraha tillaabooyinka algorithm ee jihada lidka ku ah (negative).
Muxuu xakameynayaa heerka waxbarashadu?
Heerka waxbarashadu waxa uu cabbiraa inta uu miisaanku u socdo cusboonaysiin kasta; xad-dhaaf aad u weyn, oo aad u yar ayaa ka dhigaya tababarka si xanuun leh oo gaabis ah.
Sidee buu dulucda dufcada yar-yar uga duwan yahay isticmaalka kaydinta xogta oo dhan?
Dufcad-yar iyo stochastic gradient soo degista waxay ku qiyaasaan gradient-ka iyadoo la isticmaalayo muunado yaryar, taas oo dedejisa tababarka oo ku kordhisa buuq waxtar leh.
Dhibaato noocee ah ayaa keeni karta heerka waxbarashada oo aad u weyn?
Tallaabooyinka waaweyni waxay dhaafi karaan inta ugu yar oo ay ku boodboodaan ama qarxi karaan, taasoo keenaysa in khasaaruhu uu bato halkii la dejin lahaa.
Muxuu xawligu ku kordhiyaa soo degitaanka gradient?
Momentum waxa uu xanbaarsan yahay celcelis ahaan socodka gradients ee hore, isaga oo ka caawinaya wax qabadku in uu dhaqsiyo badan u dhex maro dooxooyinka oo uu qoyyo moolalka.