Tilmaamaha aasaasiga ah

Joogista iyo Joogteynta Stochastic

Joojinta waa khiyaamo joogto ah oo si aan kala sooc lahayn u damisa qayb ka mid ah neurons-ka inta lagu jiro tillaabo kasta oo tababar ah, taasoo ku qasbeysa shabakadda inay dhisto wakiillo aan badnayn, oo adag.

2 daqiiqo akhriMarkii u dambaysay ee la cusbooneysiiyay

Dulmar

Waxay noqotay mid ka mid ah farsamooyinka ugu saamaynta badan ee lagula dagaallamo kufilanka waxbarashada qoto dheer.

quusid qoto dheer

Waxaa soo bandhigay kooxda Hinton ee ku dhawaad ​​2012, ka tagista waxay ka hadashaa daciifnimada muhiimka ah ee shabakadaha waaweyn: neerfayaasha ayaa la qabsan kara, barashada si ay u saxaan khaladaadka midba midka kale siyaabaha kaliya ee ka shaqeeya xogta tababarka. Baas kasta oo horudhac ah inta lagu jiro tababarka, ka-tagiddu waxay si aan kala sooc lahayn u dejinaysaa wax-soo-saarka neuron-ka eber iyadoo leh xoogaa p (badanaa 0.5 oo lakabyo cufan ah). Sababtoo ah neuron kasta ayaa laga yaabaa inuu baab'o, shabakadu kuma tiirsanaan karto iskaashiga jilicsan waana inay ku faafisaa macluumaadka waxtarka leh qaybo badan. Tani waxay u dhaqantaa sida tababarka isku dhafka shabakadaha khafiifsan ee wadaaga miisaanka. Waqtiga imtixaanka ka joojinta waa la damayaa waxaana la isticmaalaa shabakada buuxda, iyada oo hawlqabadyadu la miisaameen si wax soo saarka la filayo uu u dhigmo tababarka. Natiijadu waxay caadi ahaan ka fiican tahay guud ahaan kharashka tababarka wax yar ka dheer.

Aragtida Farsamada

Inta lagu jiro tababarka cutub kasta waxaa lagu hayaa ixtimaal (1 laga jaray p) iyada oo loo marayo maaskaro aan kala sooc lahayn, sidaa darteed shabakado-hoosaadyo kala duwan ayaa laga qaadaa qayb kasta. Qaab-dhismeedka casriga ahi waxay adeegsadaan ka-tagitaan rogan: hawl-qabadyada badbaadada waxa loo qaybiyaa (1 laga jaray p) wakhtiga tareenka, sidaa awgeed looma baahna miisaan marka la eego. Kala soocidani waxay duraysaa qaylada ka niyad jabinaysa la qabsiga la qabsiga iyo qiyaasaha celceliska tirada jibbaarada ee shabakad-hoosaadyada miisaanka la wadaago, qaab raqiis ah oo isku-ururin ah.

Saamaynta Istiraatijiyadeed

Go'aamo cad

Waxay kaa caawinaysaa inaad kala saartid sheegashooyinka farsamada cad iyo luqadda suuq-geynta.

Qiimaha iyo miisaaniyada

Waxaad waydiin kartaa su'aalo fulineed oo wanaagsan ka hor inta aadan lacag ama waqti bixin.

Kooxda iyo socodka shaqada

Kooxaha fahamka la wadaago waxay sameeyaan wax soo saar, siyaasad, iyo go'aano waxbarasho oo wanaagsan.

Mustaqbalka ka bixida iyo nidaaminta Stochastic

Shabakadaha aragga ee isbedbeddelka ah, caadiga ahaanshaha dufcadda ayaa si weyn u barakicisay ka-tagidda heerka caadiga ah, laakiin kala duwanaanshiyaha ayaa ku horumara meelo kale: Transformers-ku waxay khuseeyaan ka-tagidda iyo lakabyada quudinta, iyo DropPath (qoto dheer) waxay hoos u dhigtaa dhammaan baloogyada haraaga ah. Ka tagista Monte Carlo, taas oo ka dhigaysa ka tagista firfircoonida marka la eego, waxaa loo isticmaalaa in lagu qiyaaso hubanti la'aanta moodeelka. Filo nidaaminta stochastic si ay u ahaato qalab dabacsan, oo qaab dhismeedkiiba lagu habeeyay halkii aad ka ahaan lahayd hal cunto oo go'an.

Dhaqangelinta Adduunka-dhabta ah

Ku darida lakabka daadinta oo leh p ku dhawaad 0.5 inta u dhaxaysa lakabyada cufan ee sawirka ama kala soocida qoraalka gudaha PyTorch ama Keras

Moodooyinka beddelka ee codsanaya ka tagista miisaanka dareenka iyo firfircoonida horay u sii socota inta lagu jiro tababarka ka hor

Ka tagista Monte Carlo, halkaas oo ka-tagitaanku uu ku sii jiro fikradda si loo soo saaro qiyaasaha hubin la'aanta ee saadaasha caafimaadka ama badbaadada-muhiimka ah

Qoto dheer ee Stochastic (DropPath) ayaa si aan kala sooc lahayn uga boodaya baloogyada haraaga ah si ay u habeeyaan shabakadaha aadka u qoto dheer sida ResNets iyo transformers aragtida

Khatarta & Dariiqyada Ilaalada

Kooxo kala duwan ayaa laga yaabaa inay isla erey u isticmaalaan si kala duwan, marka hore u qeex baaxadda.

Tilmaamaha ayaa u ekaan kara kuwo xooggan halka waxqabadka dhabta ah ee dunidu aanu sinnayn.

In la iska indho tiro tayada xogta iyo qorshayaasha qiimayntu waxay inta badan abuurtaa natiijooyin jilicsan.

Qorshe Hawleedka Dhaqangelinta

1

Ka bilow qeexidda luqadda cad ee natiijada aad u baahan tahay.

2

Dooro hal cabbir guusha iyo hal xaalad guuldarro ka hor tijaabada.

3

Ku orod duuliye yar oo wata xogta matale, ee ma aha bandhig muuqaal ah.

4

Dukumeenti meesha ka bixida iyo nidaaminta Stochastic ay ku caawiso iyo meelaha hababka fudud ay ka fiican yihiin.

Sii wad Sahaminta

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Dropout and Stochastic Regularization quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Bilow kedis

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Hagaha xiga

Hoos-u-dhaca Stochastic Gradient oo leh Momentum

Su'aalaha soo noqnoqda

Waa maxay Joogista iyo Joogteynta Stochastic?

Joojinta waa khiyaamo joogto ah oo si aan kala sooc lahayn u damisa qayb ka mid ah neurons-ka inta lagu jiro tillaabo kasta oo tababar ah, taasoo ku qasbeysa shabakadda inay dhisto wakiillo aan badnayn, oo adag. Waxay noqotay mid ka mid ah farsamooyinka ugu saamaynta badan ee lagula dagaallamo kufilanka waxbarashada qoto dheer.

Muxuu sameeyaa ka tagista xilliga tababarka?

Ka saarista si aan kala sooc lahayn ayaa eber kasta oo neuron ah leh ixtimaalka p inta lagu jiro tababarka, sidaas darteed shabakad hoose oo khafiif ah oo ka duwan ayaa loo isticmaalaa tallaabo kasta.

Maxay tahay sababta ka tagista u wanaajiso guud ahaan?

Adiga oo si aan kala sooc lahayn uga saara unugyada, ka-tagista ayaa joojisa neerfayaasha inay sameeyaan iskaashi jilicsan oo ka shaqeeya kaliya xogta tababarka, hagaajinta awoodda.

Maxaa ku dhacaya ka-tagidda wakhtiga imtixaanka?

Marka la eego shabkada buuxda waxa ay la socotaa naafo ka tagista, hawlqabadyaduna waa la miisaamayaa si natiijada la filayo ay la mid noqoto qaybinta tababarka.

Heerka ka-tagidda p = 0.5 ee lakabka macneheedu waa qiyaastee inta lagu jiro tababarka?

Marka p = 0.5 neuron kastaa wuxuu leeyahay boqolkiiba 50 fursada ah in eber la dhigo, markaa celcelis ahaan kala badh ayaa hoos u dhacaya baaskiiba hore.

Maxaa lagu tilmaamaa ka-tegidda inta badan?

Samaynta shabakad-hoosaad ka duwan tillaabada kasta waxay ku qiyaasaysaa celcelis ahaan tiro jibbaar ah oo ah shabakado miisaan la wadaago, oo ah nooc isku-dubbarid raqiis ah.