Byagenze bite
Urupapuro rwubushakashatsi rwashyizwe ku ya 5 Kanama rukoresha uburyo buva mu bizamini byuburezi kugirango bipime ibipimo ngenderwaho byumutekano wa AI bifata, hitamo uduce duto twibisobanuro byingirakamaro, hamwe nubugenzuzi bwimyitwarire mubyitegererezo.
Abashakashatsi babiri bigenga hamwe n’abashakashatsi babiri bifatanije n’ikigo cy’Ubwongereza gishinzwe umutekano AI basuzumye uburyo 192 bwo kuganira ku bipimo umunani bikubiyemo kwanga-gusaba kwangirika, kwanga cyane ibyifuzo byiza, ingaruka zishingiye ku miterere, no kuvugisha ukuri. Suite yuzuye yarimo 5.255 ibisobanuro mbere yo gutunganya; isesengura ryagumanye 5.067 nyuma yo gukuraho ibisubizo bidafite amabara nibintu bitatandukanije moderi zapimwe.
Itsinda ryafashe icyitegererezo nkabakora ibizamini hamwe nibipimo ngenderwaho nkibipimo byikizamini, bakoresheje inyigisho yo gusubiza kugirango bagereranye ibisubizo byari bigoye nuburyo bwiza bwatandukanijwe. Mu isesengura ry’ibintu nyamukuru, igisubizo cyibintu bitatu - byavuzwe muri make nko kwanga gukomera, kuvugisha ukuri, no kugirira nabi imiterere - byasobanuye 77% byo gutandukana mubushobozi bwikitegererezo, ugereranije na 47% kubintu bimwe.
Hafi yisuzuma 20 ryakozwe, ibizamini bitatu byashizweho 25-byihuse byagaruye ibyo bintu bitatu ukoresheje munsi ya 2% ya suite. Kuri HarmBench, SORRY-Bench, na OR-Bench-Hard, hafi 10 zatoranijwe zijyanye no guhuza n'imihindagurikire yerekana urutonde rwuzuye rufite aho ruhurira na 0,92 kugeza 0.94 kandi rugabanya umubare wabasabye 97-99%; inyungu yagabanutse uko ingengo yikizamini yiyongera.
Kwiyunvikana ntabwo ari icyitegererezo gusa. Ikintu gisubiza ibitekerezo kigereranya uburyo buri kibazo kitoroshye nuburyo gitandukanya moderi nuburyo butandukanye bwo gusubiza, hanyuma igahitamo ibintu bibika imiterere yikizamini kinini. Abanditsi bagereranije ifishi ngufi ihamye hamwe no guhitamo guhuza n'imihindagurikire y'ikirere kandi bakora isuzuma aho gupima gusa amakuru yakoreshejwe mu guhitamo ibisobanuro. Igishushanyo gishyigikira ibisobanuro bigufi bivuga ko urutonde rusanzwe rushobora kubyara neza; ntabwo yerekana ko ikizamini cya 10- cyangwa 25 gishobora kuvumbura uburyo bushya bwo gutsindwa.
Ibisobanuro birambuye: Rivera and colleagues' research paper on arXiv ↗
Impamvu ari ngombwa
Ubushakashatsi bwerekana ko ibisobanuro byatoranijwe neza bishobora gutuma igenzura ryumutekano wa AI rihendutse utiriwe wibwira ko buri gipimo gipima amanota y’umutekano rusange.
Ibizamini bihendutse birashobora kureka abitezimbere, laboratoire nto, hamwe nabasesenguzi bigenga bagenzura verisiyo yicyitegererezo mugihe cyamahugurwa, guhuza neza, kubara, hamwe na sisitemu-ihinduka. Igisubizo kijyanye no kwerekana ibipimo ngenderwaho bihari neza, kutagura ibyo bipimo bishobora kumenya.
Isesengura ryibintu naryo ryerekana amanota yo gucuruza. Ibipimo byerekana ibihembo byangwa birashobora guhuzagurika, mugihe igipimo cyo kwirinda kwangwa bitari ngombwa bihesha imyitwarire inyuranye. Kubigereranya udasobanuye uburemere birashobora guhisha niba icyitegererezo cyarabaye umutekano, gusa kibuza, cyangwa kidafite akamaro kubisabwa byiza.
Uru rupapuro kandi rwagerageje uburyo bwo kugenzura umukara-agasanduku ku myitwarire yabigambiriye. Igisubizo-cyitegererezo cyagaragaye cyatoranijwe kidakora neza ariko cyabuze imikorere idahwitse; wongeyeho ubushobozi bwamateka kugenzura yazamuye hamwe kuri 94-97% murubanza rwigana. Ibyo bishyigikira ubugenzuzi butandukanye aho gushingira ku manota imwe.
Kubateza imbere, agaciro k'ibikorwa ni inshuro. Isuzuma rigufi rirashobora gusubirwamo nyuma ya sisitemu-yihuse ihinduka, igipimo cyo kubara, guhuza neza, kuvugurura ibikoresho, cyangwa kuvugurura politiki-yumutekano udakoresheje ingengo yimibare yuzuye buri gihe. Ariko ibisubizo ni ingirakamaro gusa mugihe amakipe agumanye suite yumwimerere nkubugenzuzi bwigihe, kuzenguruka ibyemezo byafashwe, no gukora iperereza ku mpinduka zitangaje aho guhitamo neza ikizamini cyahagaritswe. Ubundi cheque ihendutse irashobora guhinduka indi ntego yo gukabya.
Uburyo bukoreshwa: Uburyo bukora
Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.
crm_get_transaction(id='4092').Which description best fits "narrow AI", the kind of AI in use today?
Ibyo kureba
Reba kwigana byigenga, kwemeza imiryango yicyitegererezo izaza, nibimenyetso byerekana ko ibizamini bigufi byerekana imyitwarire hanze y'ibipimo bagenewe kubyara.
Nibisobanuro bishya, ntabwo byarangiye urungano-rusubiramo. Isesengura ryihishe-ryakoreshejwe ryakoresheje icyitegererezo 134, abanditsi bavuga ko ari gito ukurikije amahame asanzwe ya psychometrike, kandi ubundi buryo bwo kuvoma bwagumanye ibintu bibiri aho kuba bitatu. Amazina yibintu ni incamake yibisobanuro, ntabwo byemewe ibisobanuro byumutekano.
Buri cyitegererezo cyatanze igisubizo kimwe kuri progaramu iboneka binyuze muri OpenRouter, kandi buri gipimo cyakoresheje umucamanza wabigenewe. Ibizamini bigufi bivamo birashobora kuragwa inenge mubisobanuro byumwimerere, amategeko yo gutanga amanota, gukwirakwiza ururimi, n'abacamanza; abanditsi bavuga mu buryo bweruye ko kwikuramo biterekana ko igipimo cyerekana umutekano woherejwe cyangwa kigakomeza gutanga amakuru kuri moderi zizaza.
Ibizamini byo kumusenyi byakoreshejwe byateje ibinyabuzima byicyitegererezo aho kuba icyitegererezo cyateguwe neza kugirango wirinde isuzuma, bishobora kuba byoroshye kubimenya. Igenzura rya API rishyiraho imyitwarire ikomeza, ntabwo iranga uburemere bwikitegererezo bwihishe, kandi ubushakashatsi ntabwo bwagerageje umwanzi watojwe byumwihariko gutsinda uburyo bwubugenzuzi.
Urupapuro rwingenzi cyane rwurupapuro ruri hagati yubushobozi bwo gupima no kwizeza umutekano. Ifishi ngufi irashobora kugereranya ibintu byihishe bigaragara mubipimo byumwimerere, ariko iragwa ururimi rwikigereranyo, umucamanza, guhita ukora, hamwe nibibanza bihumye. Isuzuma ry'ejo hazaza rigomba gusuzuma indimi nyinshi, ibikoresho-bifashisha ibikoresho, ibiganiro birebire, icyitegererezo cyiza-cyiza, hamwe n'imanza zigenga z'abantu. Bagomba kandi gutanga raporo mugihe amanota yagabanijwe ahindutse adahungabana, kuberako ihuriro ryiza kumibare yatanzwe rishobora guhisha kunanirwa kumuryango wintangarugero.
Amategeko ngenderwaho yo kurera akurikizwa kuri izo mbogamizi: koresha ibizamini bigabanijwe nka sentinel, ntabwo ari imyanzuro. Amakipe arashobora kuyayobora kenshi kugirango asubire inyuma, hanyuma azamure impinduka kumurongo wuzuye no gusuzuma abantu mugihe ifishi ngufi yimutse muburyo butunguranye. Ubushakashatsi bwite bwibimenyetso bushyigikira ibikorwa byakazi kuko imiterere yibintu yakomotse kubitekerezo byihariye, abacamanza, nibisubizo by'icyitegererezo. Gutangaza ibintu byatoranijwe, kode yo gutoranya, ibisubizo byatanzwe, hamwe namateka ya verisiyo byemerera abasesengura bigenga kugenzura niba ibizamini bigufi bikomeza gutanga amakuru nyuma yabateza imbere bababonye na nyuma yimiryango mishya yicyitegererezo ihindura ikwirakwizwa ryibisubizo.
Gukorera mu mucyo bimwe bifite akamaro iyo moderi igezweho. Ikizamini kigufi cyahinduwe ku gisekuru kimwe gishobora guhinduka byoroshye, bigufi cyane, cyangwa kubwimpanuka bigahuzwa na sisitemu nshya. Amakipe agomba kubika verisiyo zabanjirije iyi, akerekana igihe ikintu cyangwa umucamanza bihindutse, kandi bagatanga raporo yigihe cyizere aho kwerekana urutonde rugabanijwe nkamanota yumutekano. Iyo myitozo ihindura impapuro zikora neza muri gahunda yo kugenzura mugihe hagomba kugenzurwa ibipimo byumwimerere kugirango bisuzumwe byimbitse.