Buyela Ezindabeni
UkuqambaAI Understanding ukwaziswa

Amamodeli Olimi Lwe-Radiology Abonisa Ukwehluleka Okufihliwe Ngaphansi Kokushintshwa Kwedatha, Okutholwe Ngaphambili

Ukuphrinta kusengaphambili okusha kubika ukuthi amamodeli olimi lombono wezokwelapha angabonakala ethembekile kudatha ejwayelekile kuyilapho ehluleka ukudluliswa kwedathasethi ehlukahlukene, ukuqondanisa kwe-multimodal kanye nokuhlolwa kwezinqamuleli.

5 min readRead the primary source
Primary-source image accompanying Radiology Vision-Language Models Show Hidden Failures Under Data Shifts, Preprint Finds
Idokhumenti yomthombo oyinhlokoUmthombo urekhodiwe
Umshicileli
arxiv.org
Isixhumanisi somthombo
arxiv.orghttps://arxiv.org/abs/2608.25251
Uhlobo lomthombo
Idokhumenti eyisisekelo — isimemezelo esisemthethweni, iphepha, ukugcwalisa, noma ikhasi lomuntu wokuqala esilifunda ngokuqondile.
UmongoQonda lokhu ngemizuzwana engama-60

Qala lapha

Imigomo ebalulekile

Ukujwayela
Imodeli isebenza kahle kangakanani kudatha entsha, engabonakali ngaphandle kwesethi yokuqeqeshwa.
Ukubuyisa
Ukuthola imibhalo efanele noma amarekhodi emthonjeni wolwazi wombuzo.
Isethi yedatha
Iqoqo lezibonelo ezihlelekile noma ezingahlelekile ezisetshenziselwa ukuqeqeshwa, ukuqinisekiswa, noma ukuhlola.
ZihloleImibuzo Ecacisiwe yamamodeli e-AI

Kwenzekeni

Iphrinta ka-Ayoub Louaye Bouaziz, u-Lokmane Chebouba kanye no-Yassine Himeur ihlola ukuthi yiziphi amamodeli olimi lombono wezokwelapha afunda kudatha ye-radiology nokuthi ukuziphatha kwawo kushintsha kanjani lapho isizinda sokuthola, ukugada okubhanqiwe noma iphrothokholi yokuhlola ishintsha. Kuhanjiswe ku-arXiv ngo-Aug. 26, 2026, ucwaningo lusebenzisa i-NIH ChestXray14, CheXpert, PadChest ne-OpenI.

I-preprint ifunda amamodeli olimi lombono wezokwelapha, amasistimu ahlanganisa izithombe zezokwelapha nokugadwa okuhlobene nolimi noma ukubuyisa. Umbuzo wayo oyinhloko ukuthi ingabe ikhono elibonakalayo ku-radiology liyasinda yini ekushintsheni kwedatha nezimo zokuhlola. Ababhali babeka lokhu njengendawo eyimpumputhe yezinga lokumelela ehambisana nalokho abakubiza nge-epistemic intelligence, kodwa ngokusobala bathi abaphakamisi isilinganiso esisemthethweni sokungaqiniseki kwe-epistemic. Lowo mkhawulo ubalulekile: iphepha lihlola izindlela zokwehluleka ezihambisana nokudluliswa kolwazi nezethulo zemodeli, alihlinzeki ngesilinganiso esiphelele sokuthi uhlelo luyazi yini uma lungalungile.

Ucwaningo luhlukanisa izivivinyo ezimbalwa esikhundleni sokuphatha ukujwayelekile njengomphumela owodwa. Besebenzisa i-NIH ChestXray14 kanye ne-CheXpert, ababhali bahlukanisa ukudluliswa kokubukwayo komthombo kuphela wedathasethi kusuka ekuxilongeni okungagadiwe kokuzijwayeza kwesizinda. Bese besebenzisa i-PadChest ne-OpenI ukuze bahlole ukuqondanisa kwe-multimodal ngokusebenzisa ukubuyisa okuqinile kwenkomba ye-pair-index. Iphepha futhi likala ukuthi ulwazi olususelwe kumethadatha mayelana nomthombo wedatha luhlala lutholakala yini ekushumekeni okufriziwe. Lo mklamo uvumela ababhali ukuthi babuze imibuzo emithathu ehlobene kodwa ehlukile: ukuthi izici ezibukwayo zidluliswa yini phakathi kwamasethi edatha, ukuthi ukumataniswa kombhalo nomfanekiso kuhlala kuhambisana yini ngaphansi kokuhlolwa kwangaphandle, nokuthi ingabe izethulo zigcina ulwazi olungase lusebenze njengommeleli wesizinda somthombo.

Imiphumela ebikiwe ixubile. Ekuqhathanisweni okufanayo kwe-ResNet-18, ukuqalisa kokubona ozigadile kuthuthukisa ukudluliswa kwe-NIH-to-CheXpert okuhlobene nokuqalwa kwe-ImageNet egadiwe. Ukuzivumelanisa nezitha kusiza kuphela embusweni omncane futhi kuba nokungazinzi njengoba ingcindezi yokuphikisana ikhula. Ngaphansi kokuhlolwa kokucindezeleka kwe-OpenI kwangaphandle, ukubuyiswa kwe-multimodal exact-pair kuhlala kuphansi. Ababhali baphinde babike ukuthi ulwazi lommeleli womthombo luhlala lutholakala kokuthi izethulo ezifundiwe. Lokhu okutholakele kwethulwa njengobufakazi bokuthi ukushintsha indawo yokuqeqesha noma yokuhlola kungaveza ubuthakathaka obungabonakali endaweni evamile.

Ukuhlaziywa kwekhwalithi kungeza ukuhluka kunelebula elula yokwehluleka. Ukuhlaziya okuseduze komakhelwane kanye ne-Grad-CAM kubonisa ukwakheka kwedathasethi ekholekayo ngokomtholampilo kanye namaphethini okunaka kwe-thoracic ezimeni eziningi. Ngesikhathi esifanayo, izithombe ezinzima zedivayisi kanye namacala anamanga ahlala engaqondakali. Leli phepha liphinde libike ukuthi ukuhlolwa kwezakhiwo ezisizayo kuncike emsebenzini futhi akusunguli izinga lomhlaba wonke le-backbones. Umthombo ukuphrinta kwangaphambili kwe-arXiv v1, futhi i-abstract ayiwuhlonzi umkhiqizo osetshenzisiwe, isilingo somtholampilo, umphumela wesiguli noma isistimu eqinisekisiwe ngokuzimele.

Imininingwane yomthombo: arxiv.org ↗

Kungani kubalulekile

Okutholakele kuphonsela inselelo ukuhlolwa okuncike kakhulu ekusebenzeni kwesizinda. Ababhali babika ukuthi ukudluliswa kwedathasethi enqamulayo, ukubuyiswa kwamapheya okubili kanye nokuhlolwa kokumelela kuveza ubuthakathaka obungase buhlale bufihliwe ngaphansi kwephrothokholi eyodwa yokuhlola. Lokho kubalulekile kubacwaningi nezinhlangano ezihlola ukuthi ingabe amasistimu e-multimodal yezokwelapha athembekile yini ngale kwezimo zedatha athuthukiswe kuzo.

Ukubaluleka okungokoqobo ukuthi amaphuzu aphezulu kudathasethi eyodwa ye-radiology angase anele ukusungula ukuziphatha okuthembekile kwenye indawo. Ababhali babika ukuthi amamodeli angabonakala ethembekile esizindeni kuyilapho ehluleka uma isizinda sokutholwa, ukugadwa okubhanqiwe noma izinguquko zephrothokholi yokuhlola. Esimeni sezokwelapha, lezo zimo ziyingxenye yokuthi uhlelo lwe-AI luhlangabezana kanjani nedatha yangempela. Imodeli encike ezicini ezingadluliseli ingaziphatha ngendlela ehlukile uma izithombe zivela komunye umthombo noma uma ukubhanqa kwesithombe nombhalo nemithetho yokuhlaziya ishintsha.

Ucwaningo luphinde lugxilise ukunaka kulokho okugcinwe emifanekisweni yokumelwa, hhayi kuphela ekunembeni komsebenzi wokugcina. Ulwazi olubuyisekayo lommeleli womthombo alufakazi ngokwalo ukuthi imodeli isebenzise isinqamuleli kukho konke ukubikezela. Nokho, iyabonisa ukuthi ulwazi oluhlobene nesizinda somthombo luhlala lukhona ekushumekeni okufriziwe. Kuhlanganiswe nengxoxo yephepha yamamodi okuhluleka ahlobene nezinqamuleli, lowo mphumela usekela incazelo eqaphe kakhulu yokusebenza: imodeli ingase ibhale amasiginali mayelana nokuthi idatha ivela kuphi eduze nesakhiwo esihlobene nezokwelapha.

Ukubuyisa okubikiwe okuphansi kwamapheya anembile ngaphansi kokuhlolwa kokucindezeleka kwe-OpenI kuhlobene nokuhlolwa kwe-multimodal. Iphakamisa ukuthi ikhono lesistimu yolimi lwesithombe lokukhiqiza imiphumela ezwakalayo noma lenze kahle ngaphansi kwephrothokholi ejwayelekile akufanele lithathwe ngokuzenzakalelayo njengobufakazi bokuthi umfanekiso walo nokuvezwa kolimi kuhlala kuhambisana kahle ngaphansi kwezimo zangaphandle. Ngakho-ke iphepha lenza icala lokuhlola ukudluliswa nokuqondanisa ngokuhlukana, esikhundleni sokuwagoqa abe amaphuzu esihloko esisodwa.

Umsebenzi uwusizo njengesixwayiso sokuhlola, hhayi njengobufakazi bokuthi amamodeli olimi lombono wezokwelapha awasebenziseki. Umthombo ubika amaphethini abambekayo ngokomtholampilo ezimeni eziningi zekhwalithi kanye nenzuzo yesu elilodwa lokuqalisa ekuqhathaniseni okukodwa okufanayo. Ayiqambi ukuthi okutholakele kuhumusheka kanjani ekunakekelweni kwesiguli, ukusebenza kwe-radiologist, ukuxilongwa, izinqumo zokwelashwa noma ukuphepha ekuhambeni komsebenzi okusetshenzisiwe. Lokho okungaziwa kukhawulela iziphetho ezingathathwa ngokuzibophezela kusukela ekuphrintiwe ngaphambili.

Interactive Mechanism

I-Interactive Mechanism: Indlela Esebenza Ngayo Ngempela

Hlola ubuchwepheshe obuyisisekelo ngemuva kwalokhu kuthuthukiswa ngokuhlanganyela.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
I-Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Ongakubuka ngokulandelayo

Umthombo awunikezi imiphumela egcwele yezinombolo, osayizi besampula, izikhawu zokuzethemba, imiphumela yomtholampilo noma ubufakazi bokusetshenziswa ku-abstract. Umsebenzi wokulandelela kufanele uhlole ukuthi inzuzo yokudlulisa okubikiwe kanye nobuthakathaka bokuqondanisa buyaqhubeka yini kuzo zonke izilungiselelo ezengeziwe zokutholwa, amamodeli ezakhiwo nemisebenzi yomtholampilo, kanye nokuthi ulwazi lommeleli womthombo lungancishiswa yini ngaphandle kokululaza ukusebenza okuwusizo.

Ukuphindaphinda kufanele kuhlole ukuthi ingabe inzuzo ebikiwe ye-NIH-to-CheXpert kusukela ekuqalisweni kokubonwayo ozigadile inamadathasethi engeziwe, izimo zokutholwa nemisebenzi yomtholampilo. Umthombo ukhomba ukushintsha kokusabalalisa njengokukhathazeka okumaphakathi, kodwa i-abstract ayinikezi imininingwane eyanele ukuze kutholwe ukuthi inzuzo ibanzi kangakanani noma ukuthi incike ekuqhathanisweni okuthile kwe-ResNet-18. Ucwaningo lwesikhathi esizayo kufanele futhi lucacise ukuthi yiziphi izinhlobo zokudlulisa ukuqalisa ozigadile futhi ngaphansi kwaziphi izimo zedatha.

Ukuzivumelanisa nezitha kudinga ukucutshungulwa ngoba iphepha libika kokubili uhlelo oluwusizo oluncane kanye nokungazinzi njengoba ingcindezi yabaphikisi ikhula. Ukuhlola kokulandelela kufanele kukhombe izimo ezikhiqiza lokho kungazinzi futhi kuqhathanise izindlela zokuzivumelanisa nezimo kusetshenziswa izivivinyo zangaphandle ezingaguquki. Okufanayo kusebenza ekuhlolweni kwesakhiwo okuncike emsebenzini wephepha: umthombo awusekeli ukukhetha umgogodla owodwa wendawo yonke, ngakho-ke izimangalo ezimayelana nokuphakama kwemodeli kufanele zihlale ziboshelwe kumsebenzi othile kanye nephrothokholi yokuhlola.

Abacwaningi kufanele bahlole umphumela wommeleli womthombo ngokuhambisana nezinguquko zokusebenza, bangaphathi ulwazi lwemethadatha olubuyisekayo njengokuxilongwa okuzimele. Izinyathelo ezilandelayo eziwusizo zihlanganisa ukukhomba ukuthi yimaphi amasignali asuselwe kumethadatha akhona, ukuhlola ukuthi ingabe athonya ukudluliselwa noma ukubuyisa, nokulinganisa ukuthi ingabe ukunciphisa kuyashintsha yini ukuziphatha okuhlobene nomtholampilo. Ukungacaci kahle kwephepha mayelana nezimo ezinzima zedivayisi kanye namanga kwenza lezo zibonelo zibaluleke kakhulu ekubuyekezweni kwekhwalithi nenani.

I-abstract ishiya imibuzo eminingana yezinto ezibonakalayo ingaphenduliwe. Ayiwabiki amanani aqondile okudlulisa noma okubuyisa, amasampula edathasethi osayizi, izilinganiso zokungaqiniseki, ukuqhathaniswa kwabafundi, ukutholakala kwekhodi noma imodeli, noma ubufakazi obuvela ekusetshenzisweni komtholampilo. Futhi ayiqinisekisi ukuthi okutholiwe kuvamile yini ngale kwedathasethi eshiwo nemisebenzi. Leyo mininingwane kufanele ihlolwe ephepheni eligcwele nangokuphindaphinda okuzimele ngaphambi kokuthi imiphumela isetshenziselwe ukwenza izinqumo zokusatshalaliswa noma zokuthengwa kwempahla.

Imihlahlandlela ehlobene nemibuzo

Amamodeli e-AI AchaziweAma-TransformersUkuziphatha kwe-AIHlola okwaziyo — zama imibuzo ye-AI yamahhalaBheka igama le-AI kuhlu lwethu lwamagamaLandela i-tracker yokukhishwa kwemodeli ye-AI
Uthole lokhu kuwusizo?