InoteveraGaidhi rinotevera
Mutauro weTriton weCustom GPU Kernels
Tekinoroji
Nhungamiro yehunyanzvi
Iyo kernel trick inoita kuti algorithm inoenderana nezvigadzirwa zvemukati zviite sekunge yakashandisa yakapfuma inomiririra inomiririra, pasina kunyatso gadzira zvese zvakashandurwa chimiro.
Teerera kugwaro iriAI-yakarondedzerwa · ~3 min
Izvi zvinotsigira zvisina mutsara sarudzo muganho munzira dzakadai sekutsigira vector michina, nepo kernel sarudzo uye computation zvichiramba zvakakosha.
Mazhinji algorithms anoshandisa mienzaniso kuburikidza nezvigadzirwa zvemukati. Kernel function inounganidza kufanana kunoenderana nechigadzirwa chemukati mune imwe nzvimbo nzvimbo. Kana algorithm ichigona kunyorwa uchishandisa chete maviri emukati zvigadzirwa, izvo zvigadzirwa zvinogona kutsiviwa nekernel ongororo. Iyo algorithm inobva yaita sekunge imwe neimwe yekuisa yakange yakamepuwa munzvimbo iyoyo yenzvimbo, kunyangwe iyo yakashandurwa coordination haina kumbobvira yagadzirwa zvakajeka. Iyi ndiyo kernel trick. Tsigiro vector michina muenzaniso unozivikanwa. Iyo linear SVM inogadzira muganho wakatsetseka mune yayo yekumiririra inomiririra. Iine kernel inoshanda isina mutsara, iyo optimization yakafanana inogona kugadzira muganho usiri mutsetse munzvimbo yekutanga yekuisa. A polynomial kernel inogona kumiririra kupindirana kusvika padanho rakasarudzwa, nepo radial base function kernel inopa kufanana kunodzikira nechinhambwe. Sarudzo idzi dzinoshandura kuchinjika kwechisarudzo chepamusoro chingave. Iyo kernel haingoite modhi yechokwadi. Kernel iri nyore inogona kusakwana; imwe yakanyanyisa kupfakanyika inogona kukwana ruzha. Input scaling matters nekuti kufanana-kwakavakirwa nhambwe kunoenderana nehukuru hwezvimiro. Hyperparameters senge RBF hupamhi inodzora kuti kufanana kunowira sei nechinhambwe. Sarudza marongero uchishandisa kudzidziswa uye kusimbiswa kwedata uye ongorora mashandiro ekupedzisira pane data isina kutungamira sarudzo idzodzo. Iyo computational tradeoff ine basa zvakare. Nzira dzeKernel dzinowanzo chengeta kana kuverenga kufanana pakati pemienzaniso yakawanda. Matrix akazara anokura quadratically nenhamba yemienzaniso yekudzidziswa, iyo inogona kudhura mundangariro nenguva. Kune mahombe edataseti, mamepu anoonekera, fungidziro, mhando dzemitsetse, kana dzimwe nzira dzinogona kushanda. Kernel inofanirwa kugutsa masvomhu echokwadi mamiriro eiyo yakajairwa optimization nzira, kazhinji iyo symmetric yeGram matrix yakanaka semidefinite kune yega yega inopera seti yezvipo. Kungofanana zvibodzwa hazvingoiti kuti kernels inoshanda. Huno hwunodzivirira kunyatso nyora nzvimbo ingangove yakakura, asi haibvisi computation: pairwise kernel ongororo inogona kuve yakanyanya mutengo.
Inotsigira vector classifier inoshandisa RBF kernel kupatsanura mapoka akatarisana ayo mutsara wakatwasuka haugone kupatsanura mune yekutanga-maviri-maviri maonero.
A polynomial kernel modhi yakasarudzwa maficha ekudyidzana pasina nemaoko kunyora ese chigadzirwa temu.
Mutsvaguri anofananidza kernels achishandisa nested kusimbiswa nekuti kusarudza yakanakisa kernel payekupedzisira bvunzo seti ingarerekera kune yakataurwa fungidziro.
Injiniya anotarisa saizi uye mutengo wepairi kernel matrix asati ayera kernel modhi kune yakakura kwazvo dataset.
Nzira dzeKernel dzinoramba dzichibatsira kune epakati-saizi dhataseti, akaumbwa akafanana, uye matambudziko uko dura-chaiyo pfungwa yekufanana ine chirevo. Inofungidzirwa mamepu uye hardware-aware solvers inogona kuita kuti mamwe kernel workflows awedzere, nepo akareruka mutsara kana neural nzira dzinogona kukodzera mamwe saizi yedata uye zvimiro. Iyo nzira inoshanda ndeyekusarudza zvinomiririra zvinoenderana nemitengo yakayerwa uye hunhu hwakabatika pane kufunga kuti isina mutsara kernel inongozvikwirira. Kududzira uye kusimbiswa kuchiri kutsamira pane yakasarudzwa kernel uye kuyera kwekuisa.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Iyo kernel trick inoita kuti algorithm inoenderana nezvigadzirwa zvemukati zviite sekunge yakashandisa yakapfuma inomiririra inomiririra, pasina kunyatso gadzira zvese zvakashandurwa chimiro. Izvi zvinotsigira zvisina mutsara sarudzo muganho munzira dzakadai sekutsigira vector michina, nepo kernel sarudzo uye computation zvichiramba zvakakosha.
Kernel ongororo inomirira zvigadzirwa zvemukati mune imwe nzvimbo isina kunyatso gadzira zvese zvakashandurwa coordination.
A flat separator munzvimbo yakashandurwa inogona kuenderana neasina mutsara muganho mukumiririra kwekutanga.
Zvimiro zvine zviyero zvakakura zvenhamba zvinogona kutonga maverengero echinhambwe.
A positive semidefinite Gram matrix inoenderana neyakakodzera yemukati-chigadzirwa geometry.
A dense matrix inochengetedza kufanana kune yega yega mienzaniso.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Mutauro weTriton weCustom GPU Kernels
Tekinoroji