Umtapo wezincwadi we-AI wamahhala

Funda i-AI.Mahhala phakade.

1019 imihlahlandlela yesiNgisi esicacile, izindlela zokufunda ezihlelekile, nomtapo wolwazi ovulekile — wakhiwe inhlangano engenzi nzuzo ye-501(c)(3) ezimele ukuze noma ubani aqonde i-AI yesimanje.

1019Iziqondiso zamahhala
9Amathrekhi esihloko
~2 minNgomhlahlandlela
~34hIsikhathi sokufunda

Qala lapha

Ezinhlanu izifundo ezisekelwe emiphumeleni

Isifundo ngasinye sihlanganisa imiphumela esobala, amakhono afakwe kumephu, imisebenzi yokuzilolonga, kanye netshe eliyinhloko elisetshenzisiwe.

Amathrekhi esihloko

Phequlula ngethrekhi

Gxumela endaweni oyikhathalelayo. Wonke amathrekhi anemihlahlandlela eminingi yesiNgisi esilula.

Umtapo wolwazi ogcwele

Zonke iziqondiso

1019 kwe 1019 imihlahlandlela ebonisiwe. Hlunga ngethrekhi noma sesha ngenhla.

Ulimi lwe-AI

Ukusampula Okujwayelekile

Ukusampula okujwayelekile kuyindlela yokukhiqiza umbhalo ekhetha igama elilandelayo kumathokheni okuqukethwe kwawo kolwazi kuhlala eduze nokumangala okulindelekile kwemodeli…

2 min fundaFunda
Ulimi lwe-AI

I-Mirostat Perplexity Control

I-Mirostat iyi-algorithm yokuqopha eqondisa ngokusebenzayo okukhiphayo kwemodeli yolimi kuya kokudidayo okuqondiwe (isethi yezinga lokumangala) kusetshenziswa iluphu yempendulo.

2 min fundaFunda
Ulimi lwe-AI

I-Sycophancy Kumamodeli Olimi

I-Sycophancy ukuthambekela kwamamodeli olimi lwe-AI ukutshela abasebenzisi lokho abafuna ukukuzwa, ukuvumelana nemibono eshiwo noma ukugoqa ukuze baphushele emuva ngisho…

2 min fundaFunda
Ubuchwepheshe

Ukuthuthukiswa Kwe-oda Lesibili kanye Nezindlela ZaseNewton

Ukwenziwa kwe-oda lesibili kusebenzisa ulwazi lwe-curvature (i-matrix ye-Hessian yokuphuma kokuphuma kwesibili) ukuthatha izinyathelo ezihlakaniphile eziya kokuncane, hhayi nje emthambekeni.

2 min fundaFunda
Okuyisisekelo

Ukuwohloka kwesisindo kanye nokuhlelwa kabusha kwe-L2

Ukuwohloka kwesisindo kuyindlela elula, enamandla egudluza izisindo zemodeli ziye kuziro ngesikhathi sokuqeqeshwa, idikibalise ekuthembeleni kakhulu kunoma iyiphi...

2 min fundaFunda
Okuyisisekelo

Ukuyeka kanye ne-Stochastic Regularization

I-Dropout iyisu elijwayelekile elivala ngokungahleliwe ingxenye yama-neurons phakathi nesinyathelo ngasinye sokuqeqesha, okuphoqa inethiwekhi ukuthi yakhe engafuneki, eqinile…

2 min fundaFunda
Ubuchwepheshe

I-RMSNorm kanye Nokwejwayela Kwangaphambi Kongqimba

I-RMSNorm iyisendlalelo sokujwayelekile esingasindi esikala ukwenza kusebenze ngesikwele sencazelo yempande, kanye nezindawo zokujwayela zesendlalelo esingaphambi kwento ngayinye...

2 min fundaFunda
Ubuchwepheshe

I-SwiGLU kanye ne-Gated Activations

I-SwiGLU iwumsebenzi wokuvula isango ophindaphinda ukuqagela okukodwa komugqa wokufakwayo ngokuqagela kwesibili okucushwe yi-Swish, okusebenza njengokufundekayo...

2 min fundaFunda
Ubuchwepheshe

Amanethiwekhi Okucindezela Nokukhuthaza

Amabhulokhi we-Squee-and-Excitation (SE) avumela inethiwekhi ye-convolutional ukuthi ifunde ukuthi isiteshi ngasinye sesici singasikala kangakanani, sisilinganise kabusha ngokusekelwe kumongo womhlaba.

2 min fundaFunda
Ubuchwepheshe

I-Warmup ne-Cosine Annealing Shedules

I-Warmup ngobumnene inyusa izinga lokufunda lisuka eduze kukaziro ngaphambi kokuqeqeshwa, bese i-cosine annealing iyibolisa kahle ihlehle ilandele ijika le-cosine.

2 min fundaFunda
Ubuchwepheshe

Amazinga Okufunda Okujikelezayo

Amazinga okufunda ngamabhayisikili ajikeleza ngokuphindaphindiwe izinga lokufunda liye phezulu naphansi phakathi kwesibopho esiphansi nesiphezulu esikhundleni sokulibolisa kuphela.

2 min fundaFunda
Ubuchwepheshe

Ukunciphisa Ukuqaphela Ubukhali

I-Sharpness-Aware Minimization (SAM) iyindlela yokwenza kahle engafuni nje ukulahlekelwa okuphansi kodwa ukulahlekelwa okuphansi kuyo yonke indawo yezisindo - iflethi...

2 min fundaFunda

Uqedile ukufunda? Ake usikhombise sibone.

Hlola okufundile ngombuzo wesihloko, bese uhlola izifundo zethu ezihlelekile noma usebenzela ukuthola isitifiketi. Wonke umhlahlandlela uhlala ukhululekile ukufunda.