Uhlolojikelele
Amazinga okufunda ngamabhayisikili ajikeleza ngokuphindaphindiwe izinga lokufunda liye phezulu naphansi phakathi kwesibopho esiphansi nesiphezulu esikhundleni sokulibolisa kuphela. Lokhu kubhampa okuphikisayo kungasheshisa ukuhlangana futhi kusize isilungiseleli sibaleke amaphoyinti acijile asendaweni amancane namahhashi.
I-Cyclical Learning Rates iyibhulokhi yokwakha yobuchwepheshe ethinta ikhwalithi yemodeli, izindleko zengqalasizinda, ukubambezeleka, nokuthembeka esikalini.
I-Deep Dive
Okuhlongozwe u-Leslie Smith ngo-2015, amazinga okufunda ngama-cyclical (CLR) abekela inselele umcabango wokuthi izinga kufanele lehle kuphela. Esikhundleni salokho, inyakaza phakathi kwenani eliphansi neliphezulu eliboshwe phezu kwenani elimisiwe lokuphindaphinda ('umjikelezo'), ngokuvamile onomumo ongunxantathu. I-intuition: ukuphakamisa izinga ngezikhathi ezithile kunikeza ukuqhuma kwamandla okuvumela imodeli ukuthi igxume iphume endaweni empofu, ecijile futhi inqamule amaphoyinti esihlalo sesihlalo, kuyilapho izigaba eziphansi ziyivumela ukuthi ihlale. USmith uphinde wethula 'isivivinyo sebanga le-LR' - ukugijima okufushane okushanela inani liye phezulu ngenkathi ubuka ukulahlekelwa - ukuze uthole imingcele emihle ngokuzenzakalelayo. Unxantathu, unxantathu-ngokubola, kanye nenqubomgomo edumile yomjikelezo owodwa yonke yakhela phezu kwalo mbono.
I-Technical Insight
Inqubomgomo engunxantathu ngokomugqa inyusa izinga ukusuka kusisekelo ukuya kubukhulu ngaphezu kwesigamu somjikelezo, bese ilehlisa ngomugqa ibuyele komunye uhhafu. Ubude bomjikelezo buvamise ukusethwa ukuze buphindaphinde inani lama-epoch ambalwa. Inqubomgomo yomjikelezo owodwa isebenzisa umjikelezo omude owodwa: izinga liyakhuphuka bese liwela ngaphansi kwendawo yokuqala, kuyilapho umfutho uhamba ngokuphambene - phezulu uma izinga liphansi futhi ngokuphambene nalokho - okusebenza njengesijwayelekile futhi kunika amandla 'ukuhlangana okuphezulu' kweminye imisebenzi.
I-Mastering Cyclical Learning Rates
Amazinga okufunda ngamabhayisikili ajikeleza ngokuphindaphindiwe izinga lokufunda liye phezulu naphansi phakathi kwesibopho esiphansi nesiphezulu esikhundleni sokulibolisa kuphela. Lokhu kubhampa okuphikisayo kungasheshisa ukuhlangana futhi kusize isilungiseleli sibaleke amaphoyinti acijile asendaweni amancane namahhashi. I-Cyclical Learning Rates iyibhulokhi yokwakha yobuchwepheshe ethinta ikhwalithi yemodeli, izindleko zengqalasizinda, ukubambezeleka, nokuthembeka esikalini. Ukuze wakhe ukuqonda okujulile, phatha ama-Cyclical Learning Rates njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa Izilinganiso Zokufunda Ze-Cyclical alungiselela izakhiwo, idatha, nokukhetha kwengqalasizinda ngokumelene nokuthembeka nezindleko. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka. Ngesikhathi esifanayo, Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka.
Izinqumo zezakhiwo ziqhuba ukusebenza kanye nezindleko zokusebenza iminyaka. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha.
Imfundo yobuchwepheshe isiza amaqembu ukuthi akhethe isitaki esifanele, hhayi nje esisha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni.
Izinketho ezingcono zobunjiniyela zinciphisa izehlakalo ezinokwethenjelwa ekukhiqizeni. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
i-fast.ai ithuthukise inqubomgomo yomjikelezo owodwa njengento ezenzakalelayo yokuqeqesha abahlukanisi bezithombe ngokunemba okuphezulu kuzinkathi ezimbalwa.
Ukuhlolwa kobubanzi be-LR kushanela izinga liye phezulu ngaphezu kwamaqoqo angamakhulu ambalwa ukuze kukhethwe umkhawulo omncane kanye nomkhawulo ngaphambi kokugijima kwangempela.
Ukuhlanganisa isifinyezo kulondoloza indawo yokuhlola imodeli ekupheleni komjikelezo ngamunye, kukhiqiza iqoqo lamahhala kusukela ekugijimeni kokuqeqeshwa okukodwa.
I-Stochastic Gradient Descent with Warm Restarts (SGDR) ngezikhathi ezithile isetha kabusha izinga libe inani eliphezulu ukuze ubalekele i-minima ebukhali.
Amaphethini Okusebenzisa
Amazinga Okufunda Okujikelezayo ekusebenzeni
i-fast.ai ithuthukise inqubomgomo yomjikelezo owodwa njengento ezenzakalelayo yokuqeqesha abahlukanisi bezithombe ngokunemba okuphezulu kuzinkathi ezimbalwa.
i-fast.ai yandisa inqubomgomo yomjikelezo owodwa njengento ezenzakalelayo yokuqeqesha abahlukanisi bezithombe ngokushesha ukuze babe nokunemba okuphezulu ngezikhathi ezimbalwa Amathimba ngokuvamile athola imiphumela engcono uma echaza imikhawulo yekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amazinga Okufunda Okujikelezayo ekusebenzeni
Ukuhlolwa kobubanzi be-LR kushanela izinga liye phezulu ngaphezu kwamaqoqo angamakhulu ambalwa ukuze kukhethwe umkhawulo omncane kanye nomkhawulo ngaphambi kokugijima kwangempela.
Ukuhlolwa kobubanzi be-LR kushanela izinga liye phezulu ngaphezu kwamaqoqo angamakhulu ambalwa ukuze kukhethwe umkhawulo omncane kanye nomkhawulo ngaphambi kokugijima kwangempela Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amazinga Okufunda Okujikelezayo ekusebenzeni
Ukuhlanganisa isifinyezo kulondoloza indawo yokuhlola imodeli ekupheleni komjikelezo ngamunye, kukhiqiza iqoqo lamahhala kusukela ekugijimeni kokuqeqeshwa okukodwa.
Ukuhlanganiswa kwesithombe esifinyeziwe kusindisa indawo yokuhlola imodeli ekupheleni komjikelezo ngamunye, kukhiqiza ukuhlanganisa kwamahhala kokukodwa kokuqeqeshwa Amathimba ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amazinga Okufunda Okujikelezayo ekusebenzeni
I-Stochastic Gradient Descent with Warm Restarts (SGDR) ngezikhathi ezithile isetha kabusha izinga libe inani eliphezulu ukuze ubalekele i-minima ebukhali.
I-Stochastic Gradient Descent with Warm Restarts (SGDR) ngezikhathi ezithile isetha kabusha izinga libe inani eliphezulu ukuze abaleke acijile ama-minima Teams ngokuvamile athola imiphumela engcono uma echaza imikhawulo yekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Ukuthuthukisa ibhentshimakhi eyodwa kungafihla ubuthakathaka obubanzi besistimu.
Izindleko zengqalasizinda nezokulungisa zivame ukubukelwa phansi.
Izikhala zokuphepha nokubonakala zingakhula njengoba izinhlelo ziba nzima kakhulu.
Ukuqalisa Umhlahlandlela
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa.
Chaza ukubambezeleka, ikhwalithi, nezindleko ezihlosiwe ngaphambi kokuqaliswa. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha.
Ibhentshimakhi ngaphansi komthwalo wangempela nezimo zedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi.
Ukuqapha amathuluzi amaphutha, ukukhukhuleka, nomthelela wabasebenzisi. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala.
Lungiselela izindlela zokuhlehlisa nezigameko ngaphambi kokukala. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.