Tike ya Tombora Hypothesis
Hypothesis ya Tombora ya Lotere ivuga ko imbere mu muyoboro munini, watangijwe ku buryo butunguranye uhisha uduce duto duto - 'tike yatsindiye' - ko, watojwe wenyine uhereye ku buremere bumwe bwa mbere, ushobora guhuza umurongo wuzuye.
Incamake
It matters because it suggests we are training far more parameters than we actually need.
Kwibira cyane
Byasabwe na Jonathan Frankle na Michael Carbin muri MIT muri 2018, hypothesis yavuye mubushakashatsi bwo gutema. Mubisanzwe urashobora gutema umuyoboro watojwe kugeza kuri 10-20% yuburemere bwawo udatakaje neza, ariko imyitozo iyo rezo ntoya kuva kera irananirana. Frankle na Carbin babonye amayeri: komeza amahuza asigaye 'uburemere bwambere. Iyo sisitemu ntoya - itike yatsindiye - hanyuma ikitoza muburyo bwuzuye mubwigunge, rimwe na rimwe byihuta kuruta umwimerere wuzuye. Bamenye amatike babinyujije kuri 'iterativeitude pruning': gari ya moshi, gutema uburemere buke-bunini, gusubiza abasigaye ku ndangagaciro zabo za mbere, no gusubiramo. Igisubizo cyerekana kurenza urugero cyane cyane bifasha muburyo bwiza bwo kubona ibintu neza, ntabwo bivuze ko uburemere bwose bukenewe kugiti cye.
Ubushishozi
Inzira yibanze nuburyo bukabije bwo gutema hamwe no gusubiza inyuma ibiro: nyuma yimyitozo, ikureho uburemere buke buke, usubize uburemere busigaye kubitangizwa ryambere (cyangwa kugenzura imyitozo hakiri kare, kunonosora bita 'rewinding'), hanyuma wongere. Ihuriro rya maskike idasanzwe KANDI itangizwa ryayo niyo ituma itike 'itsindira' - kubishaka gutangiza mask imwe isenya ingaruka.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza ka Tike ya Tombora Hypothesis
Amatike ya tombora yubushakashatsi mubutoza imiyoboro idahwitse kuva yatangira kuzigama compte ningufu, no kumenya niba amatike yoherezwa mumibare yimirimo. Kugabanya gutondekanya gutondekanya kuri miliyari-ibipimo bikomeza kuba bihenze, bityo imirimo irakomeza gushakisha amatike ahendutse cyangwa kwerekana ko ariho (hypothesis itike ya tombora 'ikomeye' ivuga ko amatike abaho mugitangira nta mahugurwa namba). Tegereza karuvati hamwe nicyitegererezo cyibikoresho na AI icyatsi.
Gushyira mu bikorwa Isi
Gucomeka amashusho manini kurwego rwo munsi ya 20% yuburemere bwayo kugirango wohereze kuri terefone mugihe ukomeje neza
Kwihutisha imyitozo mukumenya no guhugura gusa gake gutsinda subnetwork
Kwiga kwimura ibiro ukoresheje itike iboneka kuri dataset imwe yo gusimbuka-gutangira imyitozo kurindi
Kugabanya imbaraga zifatika hamwe nububiko mubikoresho byoherejwe no kohereza itike yatsindiye aho kuba moderi yuzuye
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Tombora ya Tike ya Hypothesis ifasha nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lottery Ticket Hypothesis quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Chinchilla Kubara-Amahugurwa meza
Ibibazo bikunze kubazwa
What is Lottery Ticket Hypothesis?
Hypothesis ya Tombora ya Lotere ivuga ko imbere mu muyoboro munini, watangijwe ku buryo butunguranye uhisha uduce duto duto - 'tike yatsindiye' - ko, watojwe wenyine uhereye ku buremere bumwe bwa mbere, ushobora guhuza umurongo wuzuye. Nibyingenzi kuko byerekana ko duhugura ibipimo birenze ibyo dukeneye.
Niki 'itike yatsindiye' muriyi hypothesis?
Itike yatsindiye ni subnetwork ntoya, iyo itojwe kwigunga kuva muburemere bumwe bwambere, igera kubwukuri ugereranije numuyoboro wuzuye.
Kuki guhugura subnetwork yaciwe mubisanzwe birananirana keretse ukora ikintu kidasanzwe?
Ubushishozi bwingenzi ni uko mask gake ikora gusa iyo ihujwe nintangiriro yumwimerere; gutangizwa bidasanzwe biravunika.
Ninde wasabye Hypothesis ya Tike ya Tombora?
Jonathan Frankle na Michael Carbin berekanye hypothesis mu mpapuro zabo za MIT 2018.
Ni ubuhe buryo bukoreshwa mu gushaka itike yo gutsinda?
Ubunini bwa Iterative gutema inshuro nyinshi gari ya moshi, ikuraho uburemere buke-bunini, kandi igasubiza inyuma kubiciro byambere.
Niki hypothesis yerekana kubyerekeye imiyoboro minini irenze urugero?
Ubushakashatsi bwerekana ko kurenza urugero bifasha gushakisha uburyo bworoshye bwo gukora imyitozo ngororamubiri aho kuba uburemere bukenewe.