Igisubizo Cyibibazo Igisubizo
Ibisubizo Byibisubizo Byibisubizo (VQA) bireka sisitemu isubiza ibibazo byubusa-imvugo-karemano yerekeye ishusho, nka 'Abantu bangahe bambaye ingofero?' Bisaba guhuriza hamwe gusobanukirwa hamwe nikibazo kugirango utange igisubizo nyacyo.
Kwibira cyane
Ikibazo Cyibisubizo Igisubizo gihuza icyerekezo cya mudasobwa hamwe no gutunganya ururimi karemano: uhabwa ishusho nikibazo, icyitegererezo gisubiza igisubizo, gishobora kuba ijambo rimwe, interuro ngufi, cyangwa yego / oya igisubizo. Igikorwa cyamamajwe na dataset ya VQA (Antol et al., 2015) hamwe na verisiyo yayo ya VQA v2.0 yatunganijwe, ihuza ibisubizo kubisubizo byerekana intege nke zo gukeka uhereye kumyandiko yonyine. Sisitemu ishushanya ishusho nibibazo, funga ibyerekanwe byombi, hanyuma uhanure igisubizo, mumateka ukurikije ibyiciro bisubizwa neza. Uyu munsi, icyerekezo kinini-cyerekezo cyururimi nka GPT-4V, LLaVA, na PaLI gikora VQA ifunguye, itekereza kubintu, ibiranga, kubara, imibanire yumwanya, ndetse ninyandiko yanditse mumashusho.
Ubushishozi
Moderi isanzwe ya VQA ikubiyemo ishusho (CNN cyangwa iyerekwa rihindura) hamwe nikibazo (transformateur text encoder), hanyuma ikabihuza, akenshi hamwe no guhuza ibitekerezo kuburyo amagambo yibibazo yitabira uturere twamashusho. Vector yahujwe igaburira urutonde hejuru y'ibisubizo bisanzwe cyangwa decoder y'ururimi kubisubizo byafunguye. Umutego uzwi ni ururimi rubogamye: moderi irashobora gukoresha imibare yo gusubiza no kwirengagiza ishusho, iringaniza imibare nka VQA v2.0.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Ejo hazaza h'ibibazo biboneka Ibisubizo
VQA iragenda ihinduka uhereye kubisubizo-bigufi biganisha ku gufungura-kurangira, intambwe-ndende yo gutekereza hamwe nibisobanuro. Tegereza uburyo bukomeye bwo kubara, imbonerahamwe, igishushanyo, hamwe ninyandiko-shusho (inyandiko VQA), wongeyeho videwo VQA itera igihe. Kugabanya guhubuka kubogamye hamwe na salusiyo bikomeje kuba iby'ibanze, kimwe no gushingira ibisubizo mu turere twihariye twibishusho. Abafasha benshi bashoboye bazasubiza cyane ibibazo biboneka mubiganiro kuri terefone, muri robo, no mubikoresho byoroshye bifasha abakoresha kubaza aho batuye.
Gushyira mu bikorwa Isi
Kureka abakoresha impumyi bagafotora ibicuruzwa bakabaza bati 'Ni ubuhe buryohe?' cyangwa 'Itariki izarangiriraho ni irihe?'
Gusubiza ibibazo bijyanye nimbonerahamwe, ifishi, hamwe ninyandiko zisikana (inyandiko VQA) mubikorwa byubucuruzi
Guha imbaraga abafasha gucuruza no kuri e-ubucuruzi basubiza ngo 'Iyi koti ifite ingofero?' kuva ku ifoto y'ibicuruzwa
Gushyigikira isuzuma ryubuvuzi cyangwa siyanse usubiza ibibazo bigenewe ibijyanye na scan cyangwa microscopi
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Visual Question Answering quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Igisubizo
Ibibazo bikunze kubazwa
What is Visual Question Answering?
Ibisubizo Byibisubizo Byibisubizo (VQA) bireka sisitemu isubiza ibibazo byubusa-imvugo-karemano yerekeye ishusho, nka 'Abantu bangahe bambaye ingofero?' Bisaba guhuriza hamwe gusobanukirwa hamwe nikibazo kugirango utange igisubizo nyacyo.
Ni ubuhe buryo bubiri sisitemu yo gusubiza ibibazo igaragara ifata?
VQA ifata ishusho n'ikibazo kubijyanye, hanyuma itanga igisubizo gishingiye kumashusho.
Kuki dataset ya VQA v2.0 yashizweho hamwe nibisubizo 'byuzuye'?
VQA v2.0 ihuza ibibazo hamwe namashusho afite ibisubizo bitandukanye, guhatira moderi gukoresha mubyukuri ibyinjijwe aho gukoresha imibare yinyandiko.
Niki 'kubogama kururimi' muri VQA?
Ururimi kubogama ni mugihe icyitegererezo gikoresha imibare isubiza ihujwe ninteruro yibibazo aho kureba ishusho.
Nigute moderi nyinshi za VQA zihuza amashusho nibibazo byamakuru?
Moderi ya VQA ikubiyemo buri buryo kandi ikabihuza, kenshi ukoresheje guhuza ibitekerezo bityo amagambo yibibazo yitabira uturere twibishusho.
Sisitemu ya VQA isanzwe itanga ibisubizo mukora iki?
Moderi nyinshi za VQA zo hambere zafataga umurimo nkurwego rwo hejuru kubisubizo bikunze kugaragara, nubwo moderi zigezweho zitanga inyandiko ifunguye.