I-AI Foundations
Qonda ukuthi iyini i-AI, ukuthi amasistimu afunda kanjani, lapho ehluleka khona, kanye nendlela yokwahlulela izimangalo ngaphandle kokukhohlisa.
Umtapo wezincwadi we-AI wamahhala
177 imihlahlandlela yesiNgisi esicacile, izindlela zokufunda ezihlelekile, nomtapo wolwazi ovulekile — wakhiwe inhlangano engenzi nzuzo ye-501(c)(3) ezimele ukuze noma ubani aqonde i-AI yesimanje.
Qala lapha
Isifundo ngasinye sihlanganisa imiphumela esobala, amakhono afakwe kumephu, imisebenzi yokuzilolonga, kanye netshe eliyinhloko elisetshenzisiwe.
Qonda ukuthi iyini i-AI, ukuthi amasistimu afunda kanjani, lapho ehluleka khona, kanye nendlela yokwahlulela izimangalo ngaphandle kokukhohlisa.
Sebenzisa i-AI ngendlela ekhiqizayo kuyilapho uvikela ubumfihlo, ubheka imiphumela, futhi ulondoloza ukuziphendulela komuntu.
Linganisa izimo zokusetshenziswa kwendawo yokusebenza, sebenzisa abashayeli bezindiza abaphephile, kala inani, futhi uxhumane nezinguquko ngokuzibophezela.
Hlaziya izinhlelo ze-AI ngokusebenzisa amalungelo, ukulingana, ukubusa, ukuphepha, kanye nemiphumela yenzuzo yomphakathi.
Qonda amamodeli olimi, ukubuyisa, abasebenzeli, ukuhlola, izindleko, nokuvikela ukusetshenziswa ngokuklama kwesistimu okusebenzayo.
Amathrekhi esihloko
Gxumela endaweni oyikhathalelayo. Wonke amathrekhi anemihlahlandlela eminingi yesiNgisi esilula.
Umtapo wolwazi ogcwele
177 kwe 1019 imihlahlandlela ebonisiwe. Hlunga ngethrekhi noma sesha ngenhla.
Ukukhishwa kokunaka kuyindlela yokulandelela ukuthi ulwazi lugeleza kanjani ngezendlalelo zokunaka ezistakiwe ze-Transformer ukuchaza ukuthi imaphi amathokheni okokufaka athonya...
UbuchwephesheUkwenziwa kwe-oda lesibili kusebenzisa ulwazi lwe-curvature (i-matrix ye-Hessian yokuphuma kokuphuma kwesibili) ukuthatha izinyathelo ezihlakaniphile eziya kokuncane, hhayi nje emthambekeni.
UbuchwephesheI-RMSNorm iyisendlalelo sokujwayelekile esingasindi esikala ukwenza kusebenze ngesikwele sencazelo yempande, kanye nezindawo zokujwayela zesendlalelo esingaphambi kwento ngayinye...
UbuchwephesheI-SwiGLU iwumsebenzi wokuvula isango ophindaphinda ukuqagela okukodwa komugqa wokufakwayo ngokuqagela kwesibili okucushwe yi-Swish, okusebenza njengokufundekayo...
UbuchwephesheAmabhulokhi we-Squee-and-Excitation (SE) avumela inethiwekhi ye-convolutional ukuthi ifunde ukuthi isiteshi ngasinye sesici singasikala kangakanani, sisilinganise kabusha ngokusekelwe kumongo womhlaba.
UbuchwephesheI-Warmup ngobumnene inyusa izinga lokufunda lisuka eduze kukaziro ngaphambi kokuqeqeshwa, bese i-cosine annealing iyibolisa kahle ihlehle ilandele ijika le-cosine.
UbuchwephesheAmazinga okufunda ngamabhayisikili ajikeleza ngokuphindaphindiwe izinga lokufunda liye phezulu naphansi phakathi kwesibopho esiphansi nesiphezulu esikhundleni sokulibolisa kuphela.
UbuchwephesheI-Sharpness-Aware Minimization (SAM) iyindlela yokwenza kahle engafuni nje ukulahlekelwa okuphansi kodwa ukulahlekelwa okuphansi kuyo yonke indawo yezisindo - iflethi...
UbuchwephesheUkuhlola komugqa ukuthi kuhle kangakanani izethulo zangaphakathi zemodeli eqeqeshwe kusengaphambili ngokumisa inethiwekhi nokuqeqesha kuphela isihlukanisi esilula somugqa phezulu.
UbuchwephesheI-DenseNet iyinethiwekhi yokuguqula lapho ungqimba ngalunye luthola amamephu wesici azo zonke izendlalelo ezandulele njengokufakwayo.
UbuchwephesheI-bottleneck architecture iminyanisa idatha ngesendlalelo esimaphakathi esincane esincane ngaphambi kokuyinweba futhi, okuphoqa inethiwekhi ukuthi ifunde ukubumbana, ukusebenza kahle...
UbuchwephesheUkuqoqwa kwe-Gradient kukuvumela ukuthi ulingise usayizi weqoqo elikhulu kumemori ye-GPU elinganiselwe ngokufingqa ama-gradient kuma-mini-batches ambalwa ngaphambi kokubuyekeza...
Hlola okufundile ngombuzo wesihloko, bese uhlola izifundo zethu ezihlelekile noma usebenzela ukuthola isitifiketi. Wonke umhlahlandlela uhlala ukhululekile ukufunda.