Byagenze bite
Abashakashatsi barasaba Segment-kuri-Video Kugenzura, cyangwa S2V, kuri sisitemu ya AI ya multimodal isubiza ibibazo bijyanye na videwo ndende. Uburyo bukora ibibazo-nibisubizo byingero ziva mubice bigufi bya videwo, hanyuma bigakoresha izo ngero kugirango uhugure icyitegererezo kuri videwo yuzuye. Abanditsi bavuga ko hari byinshi byahinduwe mu bipimo byinshi birebire-byerekana amashusho ukoresheje ingero 10,000 za VQA, hamwe na pass imwe yimbere hamwe nibimenyetso bike bisohoka.
Uru rupapuro rwashyikirijwe arXiv ku ya 21 Kanama 2026, ruvuga ibyerekeranye na videwo ndende na moderi nini y'ururimi runini. Intangiriro yacyo nuko videwo ndende kandi igoye irimo ibintu birangaza bishobora guhisha amakuru arambuye. Nk’uko abanditsi babivuga, ibi birashobora kuyobora icyitegererezo cyo kwibanda ku bimenyetso bitari byo no gutanga igisubizo kitari cyo. Ubushakashatsi rero bushingiye ku bushobozi bwihariye bwa AI: guhuza ikibazo kijyanye na videwo mugihe cyangwa igice kiri muri iyo videwo.
Uburyo buteganijwe bwitwa Segment-to-Video Kugenzura, cyangwa S2V. Abashakashatsi babanje gutanga ibibazo-bisubiza ibibazo bivuye mubice, bigufi. Izo ngero noneho zisubizwa inyuma kuri videwo yuzuye mugihe cy'amahugurwa. Impamvu yavuzwe ni uko ibice bigufi byorohereza ibisobanuro birambuye byoroshye kubibona, mugihe amahugurwa kuri videwo yuzuye yigisha icyitegererezo guhuza ibyo bisobanuro nibibazo nubwo hariho ibintu bidafitanye isano. Uburyo bukoresha imyigire ishimangira hamwe nibisobanuro bisobanura nkigihembo cyoroheje gishingiye ku bihembo hamwe na 10,000 VQA.
Mugihe cyo gufata umwanzuro, ibisubizo bya S2V byavuyemo byashizweho kugirango dusubize hamwe inzira imwe yimbere hamwe numubare muto wibisohoka. Abanditsi bavuga ko ubushakashatsi bwabo bwerekana iterambere rihoraho ku bipimo byinshi birebire-byerekana amashusho ugereranije na moderi rusange ya multimodal hamwe nuburyo bushingiye ku bitekerezo. Basaba kandi inyungu mu mahugurwa no gukora neza. Inkomoko ntisobanura ibipimo ngenderwaho cyangwa ngo itange ingano y’inyungu zivugwa muri abstract, bityo ibyo birego bigomba gufatwa nkibisubizo byatangajwe nimpapuro aho kuba ibimenyetso bifatika byigenga.
Ibisobanuro birambuye: arxiv.org ↗
Impamvu ari ngombwa
Amavidewo maremare arimo ibintu byinshi bidafite akamaro, bigatuma bigora sisitemu ya AI kubona ibimenyetso byihariye bikenewe kugirango dusubize ikibazo. Uburyo bw'impapuro bugamije icyo kibazo mugihe ushaka kwirinda ibiciro byinshi byo gutangaza amakuru, gushushanya ibihembo bigoye hamwe nubukererwe bujyanye nuburyo bunoze bwo gutekereza. Niba byemejwe byigenga, tekinike irashobora gutuma isesengura rirerire rya videwo rifatika mugushiraho aho kubara, igihe cyo gusubiza cyangwa kuranga ibikoresho bibujijwe.
Isesengura rirerire rya videwo riragoye kubwimpamvu itaziguye: amakuru akenewe kugirango asubize ikibazo arashobora gufata igice gito gusa murwego runini. Sisitemu ya AI itunganya videwo yose igomba gutandukanya ibimenyetso bifatika nibikorwa byimbere, ibintu byasubiwemo nibintu bidafitanye isano. Uburyo bwa S2V bwibanda kumahugurwa kubimenyetso byaho mbere, hanyuma ikoresha videwo yuzuye nkuburyo ibimenyetso bigomba kugarurwa. Nicyo gisubizo cyibisubizo kubibazo bigarukira muri sisitemu ya AI ishobora gukora amashusho.
Gusaba gukora neza birashoboka cyane kuko kunoza imitekerereze akenshi bizana ikiguzi cyinyongera. Uru rupapuro ruvuga ko uburyo bwambere bushobora gusaba imbaraga-gushimangira neza-hejuru, ibisobanuro bihenze hamwe n'ibishushanyo mbonera bigoye. Ivuga kandi ko sisitemu zimwe na zimwe zigaragaza cyangwa itera-imyumvire itanga ibisubizo birebire kandi byongera ubukererwe. S2V igamije kugabanya iyo mitwaro binyuze mumahugurwa mato mato ya VQA, ibihembo byoroshye byukuri hamwe nigisubizo kimwe. Niba imikorere ivugwa yariganye, uburyo bushobora kuba ingirakamaro kubateza imbere gutunganya amashusho manini cyangwa gukora mugihe cyo gusubiza no kubara imbogamizi.
Ubusobanuro bufatika buguma buteganijwe. Imikorere myiza ntishobora kuba yonyine ubushishozi bwumvikana muri videwo nyayo, aho ibibazo bishobora kuba bidasobanutse, ibimenyetso bifatika birashobora gukwirakwira mugihe cya kure, kandi amakosa ashobora kugira ingaruka zitandukanye bitewe nibisabwa. Inkomoko ntabwo itanga ibisubizo byoherejwe, isuzuma ryabantu, ibizamini byihariye cyangwa ibipimo byatsinzwe. Ntabwo ishyiraho kandi ko uburyo bugabanya ikiguzi cyose muri buri cyiciro, kubera ko washyizeho ingero zamahugurwa yaho kandi ugategura amashusho yuzuye ashobora kwishyiriraho akazi.
Uburyo bukoreshwa: Uburyo bukora
Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.
Which component of an AI application is the machine-learning model itself?
Ibyo kureba
Urupapuro ni progaramu ya arXiv, kandi ibisobanuro byayo ntabwo bitanga inyungu nyayo, amazina y'ibipimo, ibisabwa kubara cyangwa kugereranya muburyo burambuye. Ubundi bugenzuzi bugomba gusuzuma niba ivugururwa ryatangajwe rifite uburebure bwa videwo, domaine nubwoko bwibibazo, niba guhitamo igice bizana ahantu hatabona, kandi niba uburyo bukomeza gukora neza iyo bukoreshejwe hamwe na moderi nini cyangwa zitandukanye.
Ibimenyetso bikurikiraho byingenzi ni imibare nuburyo buvuye mu mpapuro zuzuye. Basomyi bagomba gushakisha umwirondoro nubunini bwibipimo birebire-videwo, icyitegererezo cyibanze, impinduka nyazo nukuri hamwe namahugurwa hamwe nugupima. Bizaba ngombwa kandi niba igereranya rikoresha imiryango imwe yicyitegererezo, ibyinjira muri videwo no kubara ingengo yimari. Hatariho ibisobanuro birambuye, abstract ishyigikira kubaho muburyo bwateganijwe hamwe nabanditsi batanze icyerekezo cyibisubizo, ariko ntabwo ari igereranya ryukuri ryibyiza.
Igenzura rishingiye ku gice rishobora gutangiza ibicuruzwa niba clips zatoranijwe zidafite imiterere ihagije. Isuzuma rigomba gusuzuma ibibazo ibisubizo biterwa nibyabaye mbere na nyuma yicyiciro cyaho, imikoranire mubice bya kure bya videwo, cyangwa umubano wigihe gito. Igomba kandi gusuzuma niba igisekuru cyigice gikunda ibisobanuro bigaragara mugihe habuze amajwi, ibihe byakurikiranye, indangamuntu cyangwa imvugo yagutse. Inkomoko isobanura ikibazo cya videwo gisubiza ariko ntigaragaza uburyo ubwo buryo cyangwa imanza zitoroshye byakemuwe.
Kwigana byigenga bizagaragaza niba S2V ari tekinike yingirakamaro yo guhugura cyangwa ibisubizo bifitanye isano namakuru yihariye no guhitamo icyitegererezo. Igikorwa cyingirakamaro cyo gukurikirana cyagereranya uburyo nubundi buryo bukoreshwa neza bwa videwo ndende, ikagerageza kuri domaine zitagaragara no gupima amakosa yibeshya hamwe nukuri. Urupapuro rwashyizwe ahagaragara kandi ntirwigeze rwemeza ko rwemewe hanze yatanzwe. Kugeza ubwo ayo masheki aboneka, uruhare rwayo rushyigikiwe cyane nigitekerezo gifatika hamwe nigipimo cyatanzwe nabanditsi hamwe nogutezimbere imikorere, ntabwo ari ibimenyetso byerekana ko amashusho maremare ya AI yakemuye ibitekerezo byaho.