Chii chaitika
Vatsvagiri vakakurudzira Boot-uye-Feedback, kana BooF, dhizaini umo multimodal hombe yemutauro modhi inogadzira inotungamirwa-inotungamirwa tsananguro yezamu re ultrasound zvakawanikwa uye nyanzvi yekuona inoshandisa iyo mhinduro pamwe nezvinooneka. Bepa rinoshuma kuti BooF yakapfuura nzira dziripo pane akawanda mazamu-ultrasound datasets, kunyangwe iyo yakapihwa sosi isingape iwo manhamba mhinduro.
Sosi inotsanangura mazamu ultrasound seanoshandiswa zvakanyanya pakuongorora gomarara rezamu asi zvinoenderana neanoshanda. Inotaridza kushaya simba mumhando dzemitauro mikuru ichangoburwa: dzinogona kuburitsa tsananguro dzenhema nekuti hadzina ruzivo rwakakwana rwedomasi. Sekureva kwebepa, tsananguro idzi dzinogona kutsausa mamodheru enyanzvi uye kudzikisira kushanda kwekiriniki. Izvi zvinoita kuti iyo AI sisitimu pachayo ive yepakati nyaya yebasa, pane generic nhaurirano yekurapa imaging kana otomatiki. Iro bepa rakanyorwa paarXiv sekutumirwa kwaNyamavhuvhu 25, 2026, uye rinoratidza ICASSP 2026 senzvimbo yayo yekushambadzira.
Kunobva kune ruzivo rwezvinyorwa uye zvebhaibheri, asi kwete matafura ekuedza akazara kana nzira dzinodiwa kuti uongorore wakazvimiririra masaizi akataurwa. Hurongwa hwakarongwa hune nhanho mbiri dzine mazita. MuBoot Stage, iyo multimodal mutauro modhi inotungamirwa neiyo BI-RADS lexicon, izwi rakamisikidzwa rinoshandiswa kutsanangura zvakawanikwa zvekufungidzira mazamu, pamwe chete nekufungidzira kwakashata-kunopesana-kwakashata kubva kunyanzvi yechiratidzo. Chinangwa chakataurwa ndechekubatsira iyo general-chinangwa modhi kuendesa kugona kwayo kufunga kune zamu-ultrasound kuongororwa uku ichideredza kurongeka kana kusatsigirwa tsananguro. Iyo abstract inopa izvi sechinangwa chekugadzira uye nzira yakashumwa; hazviratidze kuti tsananguro yese inogadzirwa ndeye kiriniki chaiyo kana kuti kufungidzira kunobviswa. MuFeedback Stage, tsananguro dzemodhi dzakasanganiswa nezvinoonekwa kuburikidza nezvinonzi nevanyori lightweight Attention-Gated Cross-Modality Fusion Module. Iyo nyanzvi modhi inoitirwa kushandisa mhinduro yemavara uku uchisefa ruzha. Mukutaura kwekushanda, hurongwa hahutsanangurwi sekutsiva mufananidzo-based nyanzvi nemutauro wemutauro. Pane kudaro, inogadzira kudyidzana kwakarongwa umo generalist modhi inopa mutauro wakarongeka uye modhi yenyanzvi inosarudza kuti yakawanda sei yeruzivo irworwo yekubatanidza nehumbowo hwemufananidzo. Iyo sosi haitaure mazita emuenzaniso, kudzidziswa-data masosi, Hardware, inference nguva kana deployment zvinodiwa.
Vanyori vanoshuma kuti kuyedza kwakadzama paakawanda mazamu-ultrasound datasets anoratidza BooF yakanyanya kunaka nzira-ye-iyo-hunyanzvi nzira mukuongororwa kwechokwadi uye kududzira. Izvo zvichemo zvakaitwa nebepa, kwete zvakazvimiririra zvakawanikwa muzvinyorwa zvakapihwa. Hapana kurongeka kwenhamba, kunzwa, kujeka, nzvimbo iri pasi pekavha, chiyero chekududzira, nguva yekuvimba kana rondedzero yekutanga inosanganisirwa. Iyo abstract haina zvakare kutaura kana dhatabheti dzaive retrospective, manyorerwo akagoverwa, ingave mifananidzo yakabva kune akasiyana masangano, kana chero wongororo yakaitwa zvinotarisirwa mukiriniki maitiro. Izvo zvinonyanya kukosha ndezvekuti basa rinonangana nekongiri yekutadza maitiro mune yekurapa AI: sisitimu inogona kuoneka ichitaura ichitsanangura zvinoonekwa zvinoonekwa zvisipo. Muzamu re Ultrasound, apo kunaka kwemufananidzo, nzira yevashandisi uye kuonekwa kweronda kunogona kusiyana, mutauro usingatsigirwi unogona kukanganisa kutarisa kana kuvimba kwachiremba. Mavakirwo epepa anoedza kuita kuti chikamu chemutauro chipindurwe kune zvipingaidzo zviviri zvakatosungirirwa pabasa: domain lexicon uye kufanotaura kwekutanga kubva kumuenzaniso wechiratidzo. Uku ndiko kupindira kwakanyanya pane kungowedzera chatbot kune yekufungidzira mafambiro.
Iyo dhizaini inoratidza zvakare yakakura dhizaini yemubvunzo yemultimodal yekurapa AI: kufunga-chinangwa-chikuru kunofanirwa kusanganiswa sei nehudiki, hunyanzvi hwekuita basa? BooF inopa mabasa akasiyana kune izvo zviviri zvikamu. Iyo multimodal mutauro modhi inoshandiswa kuburitsa tsananguro uye kuendesa general kufunga, nepo nyanzvi yemhando inoramba yakabatana neanoona maficha uye inogona gedhi chiratidzo chemavara. Kana maitiro akashumwa achikwanisa kudhindwa, izvi zvinogona kupa nzira yekuwana imwe yekududzira inoenderana netsananguro yezvinyorwa pasina kubvumira zvinyorwa zvinogadzirwa kutonga humbowo hwemufananidzo. Zvakadaro, kwakabva hakuratidzi kuti tsananguro yakatendeka kune chaiyo sarudzo yemuenzaniso kana inobatsira kune radiologist. Izwi rekuti kududzira rinogona kureva zviyero zvakati kuti zvakasiyana, kusanganisira kubvumirana netsananguro dzenyanzvi, kugarisana kwezviwanikwa, kubatsira muzvidzidzo zvevaverengi kana kuenderana pasi pekuvhiringidza. Pasina tsananguro yepepa uye evaluation protocol, iyo yakashumwa yekuvandudza haigone kuturikirwa mune chaiyo kiriniki inobatsira. Muganho mumwe chetewo unoshanda pakurongeka: bhenji rekuvandudza rinogona kunge risingarevi mashoma akapotsa cancers, mashoma asina kufanira biopsies kana sarudzo dziri nani mukutarisira kwakajairika. Kana iyo nzira yakazogadziriswa kunze kweiyo yekutanga dataset, inogona kuve yakakosha kuzvipatara zvinoongorora rubatsiro rweAI rwezamu-ultrasound kududzira. Sisitimu inosanganisa humbowo hwemifananidzo nekufunga kwemavara inomanikidzirwa inogona kutsigira ongororo yakarongeka, kuverenga kwechipiri kana mhinduro yedzidzo. Asi mashandisiro aya angada humbowo nezve manyepo, manyepo, calibration, subgroup performance uye mhedzisiro pamaitiro ekiriniki. Vaizodawo mutoro wakajeka wezvisarudzo zvekupedzisira. Sosi rakapihwa haripe humbowo uhwu, saka zvazvinoita paruzhinji pari zvino semhedzisiro yekutsvagisa kwete kuratidzwa kwekiriniki.
Hunotevera humbowo hwakakosha ndeye yakazara ICASSP bepa uye ruzivo rwayo rwekuyedza. Vaverengi vanofanira kutsvaga mazita edhatabheti, nhamba dzemuenzaniso, kupatsanurwa kwemurwere-chikamu chechitima-yekuedza, kusimbiswa kwekunze, chiyero chekirasi, preprocessing, kuenzanisa nheyo uye ma metrics chaiwo ari shure kwekuda kwekuvandudzwa kwakanyanya. Izvo zvakare zvine basa kana modhi yakaongororwa pamifananidzo ye ultrasound kubva kumasangano kana zvishandiso zvisina kumiririrwa panguva yekudzidziswa. Kana akawanda madatasets akashandiswa chete kuedza mukati kana kugovaniswa mamwe masosi akafanana, iyo inooneka inogona kuve yakatetepa pane iyo abstract inoratidza. Kudzokorora kwakazvimirira kunofanirwa kuyedza kana zvakawanikwa zvichibva kubhutsu-uye-mhinduro dhizaini kana kubva mukusiyana mukudzidziswa, kukurudzira, kuchenesa data kana kuongorora. Zvidzidzo zvinobatsira zvinogona kuenzanisa iyo yakazara sisitimu neshanduro dzinobvisa iyo BI-RADS nhungamiro, kufanotaura kwenyanzvi kwekutanga, module yemhinduro kana modhi yemutauro. Vanofanirawo kuyera kana chimiro chemutauro chakashata, kakawanda sei gedhi renyanzvi rinoramba mhinduro yaro, uye kana hurongwa hunova nekuzvivimba zvakanyanya kana zvikamu zvose zvinogovana kukanganisa kwakafanana. Chidzidzo chemuverengi chinogona kuongorora kana tsananguro dzichivandudza sarudzo dzekuongorora kana kungoita kuti zvinobuda zvinzwike zvinonyengetedza. Kuongororwa kwekiriniki kwaizoda kuenderera mberi kweretrospective benchmark kurongeka. Zvidzidzo zvinotarisirwa zvinogona kuongorora kushanda kwevashandisi vese, zvipatara, michina ye ultrasound uye huwandu hwevarwere, uchitarisa mafambiro ebasa uye kusawirirana nevarapi. Kunyanya kutarisisa kunofanirwa kuenda kune zvisingawanzo kana kusanzwisisika zvakawanikwa, apo tsananguro isina kujeka asi isiriyo inogona kunyanya kukuvadza. Sosi yacho haitauri mamiriro ekutonga, hurongwa hwekutumira, mhedzisiro yemurwere, kuchengetedzwa kwekuvanzika kana kuwanikwa, saka hapana chimwe cheizvi chinofanirwa kutorwa kubva mukuburitswa kwebepa mumamiriro ezvinhu emusangano. Izvo zvakakoshawo kutarisa kuti masisitimu ekufungidzira anotsanangura sei uye anotaurirana kusavimbika. BooF yakagadzirirwa kusefa mameseji ane ruzha mhinduro, asi iyo abstract haitaure kana ichigona kurega, kukumbira ongororo yemunhu kana kusiyanisa mipimo yemifananidzo kubva mukusagadzikana kwemuenzaniso. Kuzivisa kweramangwana kunofanirwa kuita kuti maitiro acho aoneke uye aayedze pasi pekuchinja kwekugovera. Kusvikira humbowo hwakadaro hwavepo, BooF inonzwisiswa zvakanyanya seanovimbisa dhizaini yakataurwa mubepa rekutsvagisa, kwete sekiriniki yakasimbiswa yekuongorora chigadzirwa.
Nei zvichikosha
Kududzirwa kwemazamu eultrasound kunogona kusiyana neruzivo rwemushandisi, uye maAI masisitimu anoburitsa tsananguro isingatsigirwe anogona kugadzira imwe njodzi yekiriniki. BooF inogadzirisa zvese zviri zviviri nyaya nekumanikidza kuburitsa mutauro-modhiyo neiyo BI-RADS lexicon uye kufanotaura kwenyanzvi, yobva yasefa mhinduro yemagwaro isati yapesvedzera kuongororwa.
Operator ruzivo runogona kukanganisa mazamu-ultrasound kududzira, nepo isingatsigirwe AI tsananguro inogona kuwedzera njodzi yekiriniki.
BooF inomanikidza kubuda neBI-RADS uye fungidziro yenyanzvi yekutanga, yobva yasefa mhinduro yemagwaro isati yaongororwa.
Iyo sosi haigadziri rubatsiro rwekiriniki, tsananguro dzakatendeka, mashoma akapotsa kenza kana mashoma asina kufanira biopsies.
Interactive Mechanism: Iyo Inonyatsoshanda
Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.
Which component of an AI application is the machine-learning model itself?
Zvekutarisa zvinotevera
Mibvunzo yakakosha ndeyekuti zvakawanikwa zvakawanikwa zvakabata muzvipatara, zvishandiso, huwandu hwevarwere nevarapi, uye kana sisitimu inovandudza sarudzo kwete kungoita zvibodzwa. Iyo tsime haigadziri inotarisirwa kubatsirwa kwekiriniki, kubvumidzwa kwemutemo, kutumirwa, mhedzisiro yemurwere kana saizi uye kuumbwa kwemaseti akaongororwa.
Ongorora mazita edhatabheti, nhamba dzemienzaniso, kupatsanurwa kwevarwere-chikamu, kusimbiswa kwekunze, chiyero chekirasi, nheyo uye metrics chaiwo.
Edzai zvipatara, zvishandiso, huwandu hwevarwere uye varapi, kusanganisira zvakawanikwa zvisinganzwisisike uye zviitiko apo modhi yacho isiriyo.
Sosi yacho haitauri mamiriro ekutonga, zvirongwa zvekuendesa, mhedzisiro yemurwere, kuchengetedzwa kwekuvanzika, kuwanikwa kana maitiro asina chokwadi.