Abun Sauka Biyu
Sau biyu shine abin lura cewa yayin da samfurin ke girma, kuskuren gwaji ya fara yin muni a kusa da 'kofar shiga tsakani' amma sai ya sake samun kyawuwa - ƙetare cinikin litattafan gargajiya.
Dubawa
It matters because it helps explain why enormous, overparameterized neural networks generalize well instead of overfitting.
Zurfafa nutsewa
Ƙididdiga na al'ada na koyar da lanƙwasa mai siffa U: yayin da ƙayyadaddun ƙirar ke tasowa, kuskuren gwaji ya faɗi, ƙasa, sannan ya tashi yayin da ƙirar ta cika. Sau biyu, wanda Belkin, Hsu, Ma, da Mandal suka shahara a cikin 2019 kuma sunyi nazari akan sikeli ta OpenAI, yana nuna layin yana da zuriya ta biyu. Kuskuren gwaji ya kai kololuwa daidai a madaidaicin tsaka-tsaki - wurin da ƙirar ke da isassun sigogi don dacewa da kowane wurin horo daidai (kuskuren horon sifili). Tura wannan zuwa cikin tsarin da aka wuce gona da iri kuma kuskuren gwaji ya sake faɗuwa, sau da yawa ƙasa da tabo mai daɗi na gargajiya. Irin wannan tasiri yana bayyana a girman samfurin, lokacin horo ('epoch-hise' sau biyu), da girman saitin bayanai. Yana warware tsohuwar tsoro cewa 'ƙarin sigogi koyaushe yana nufin wuce gona da iri.'
Fahimtar Fasaha
A bakin kofa akwai ainihin mafita guda ɗaya wanda ya dace daidai da bayanan, kuma ana tilasta shi ya zama jagged da babban al'ada, don haka yana gabaɗaya mara kyau. A cikin tsarin da ya wuce gona da iri, mafi yawa mafi ƙarancin kuskuren mafita sun wanzu, kuma raɗaɗin zuriya na gangara yana kaiwa ga mafi santsi, mafi ƙanƙanta na al'ada. Wancan zaɓi na masu shiga tsakani-ƙananan rikitarwa - ba ƙidayar sigar kanta ba - shine abin da ke motsa saukowa na biyu zuwa ƙananan kuskuren gwaji.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Al'amarin Sau Biyu
Masu bincike suna amfani da sau biyu don tsaftace dokokin ƙididdiga da kuma zaɓar lokacin da za a daina horo, tun da ' horo ya daɗe, ya yi muni, sannan mafi kyau' yana da tasiri na gaske. Yi tsammanin ƙarin ƙa'idar da ke haɗa ta zuwa ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙayyadaddun ƙwayar cuta, ƙwayar ƙwayar cuta ta jijiya, da ƙugiya. A zahiri, darasin - girma da tsayi zai iya taimakawa wajen wuce yankin haɗari - ya riga ya ƙaddamar da yanke shawara don horar da ƙirar tushe mafi girma maimakon na a hankali.
Aiwatar da Gaskiyar Duniya
Bayyana dalilin da ya sa samfurin harshe na biliyan biliyan 175 ya fi dacewa fiye da na tsakiya da aka tsara a hankali duk da ƙarin ƙarfin aiki.
Zaɓin horon da ya wuce wurin da asarar tabbatarwa ke daɗa tabarbarewa na ɗan lokaci, saboda zamanin zuriya biyu na hikimar zamani yana annabta dawowa daga baya.
Gano samfurin hangen nesa wanda daidaitonsa ya nutse daidai lokacin da ƙidayar siga ta dace da girman tsarin horo, sannan a zurfafa shi cikin wuce gona da iri.
Sanar da shawarwarin girman ƙira a cikin AutoML don haka masu aiki su guje wa yankin tsaka-tsaki mai rauni.
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Takaddun inda Abun Sauka Biyu ke taimakawa kuma inda mafi sauƙi hanyoyin suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Double Descent Phenomenon quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Saukowar Gradient
Tambayoyin da ake yawan yi
What is Double Descent Phenomenon?
Sau biyu shine abin lura cewa yayin da samfurin ke girma, kuskuren gwaji ya fara yin muni a kusa da 'kofar shiga tsakani' amma sai ya sake samun kyawuwa - ƙetare cinikin litattafan gargajiya. Yana da mahimmanci saboda yana taimakawa bayyana dalilin da yasa manyan hanyoyin sadarwar jijiyoyi masu yawa suka mamaye da kyau maimakon wuce gona da iri.
A ina ne kuskuren gwaji yakan kai kololuwa a cikin lanƙwan saukowa biyu?
Kuskuren karu yana faruwa a bakin kofa, inda samfurin ke da isasshen ƙarfin fitar da kuskuren horo zuwa sifili tare da ainihin tsayayyen bayani guda ɗaya.
Me zai faru don gwada kuskure yayin da samfurin ke zama da yawa?
A cikin overparameterized tsarin mulki kuskure gwajin saukowa a karo na biyu, wanda shine ma'anar fasalin da ya ba da sau biyu sunansa.
Me yasa zuriyar gradient ke taimakawa a cikin tsarin tsarin da aka wuce gona da iri?
Tare da ɗimbin hanyoyin warware kurakuran sifili da yawa, ƙayyadaddun ra'ayin zuriyar gradient yana tafiya zuwa ga mafi santsi, mafi ƙanƙanta na al'ada, wanda ke haɓaka mafi kyau.
'Epoch-hikima' sau biyu sau biyu yana nufin tasirin bayyana a matsayin aikin me?
Sau biyu sau biyu na iya faruwa tare da axis na lokacin horo: kuskuren gwaji na iya yin muni sannan ya inganta yayin da ake ci gaba da horarwa don ƙarin zamanin.
Wane ra'ayi na gargajiya ya ƙalubalanci zuriya biyu?
Ya ci karo da littafin karatun U-dimbin lanƙwasa wanda ya ce ƙarin rikitarwa da suka wuce aya koyaushe yana ƙara kuskuren gwaji ta hanyar wuce gona da iri.