Buyela Ezindabeni
UkuqambaAI Understanding ukwaziswa

Iphepha lihlongoza ukujwayela okungenamthombo ngokushesha kumamodeli olimi lombono

Ukuphrinta kusengaphambili okusha kuphakamisa i-DSSG-PAC, indlela yokulungisa amamodeli olimi lombono ngaphandle kwedatha yomthombo noma amamodeli emithombo eqondene nomsebenzi othize. Ababhali babika ukuthi igcina kakhulu ukusebenza kokuzivumelanisa nezimo ngenkathi inciphisa isikhathi esiphelele sokujwayela ngo-18.9%.

5 min readRead the primary source
Source-provided image accompanying Paper proposes faster source-free adaptation for vision-language models
Idokhumenti yomthombo oyinhlokoUmthombo urekhodiwe
Umshicileli
arxiv.org
Isixhumanisi somthombo
arxiv.orghttps://arxiv.org/abs/2608.28145
Uhlobo lomthombo
Idokhumenti eyisisekelo — isimemezelo esisemthethweni, iphepha, ukugcwalisa, noma ikhasi lomuntu wokuqala esilifunda ngokuqondile.
UmongoQonda lokhu ngemizuzwana engama-60

Qala lapha

Imigomo ebalulekile

Imodeli Yolimi Lombono (VLM)
Imodeli ye-multimodal ecubungula ngokuhlanganyela ulwazi olubonakalayo nolubhaliwe.
Ulwazi Distillation
Ukuqeqesha imodeli encane ukulingisa okuphumayo kwemodeli enkulu.
Inkumbulo (Inkumbulo yomenzeli)
Ingqikithi egciniwe umenzeli we-AI usebenzisa ezinyathelweni zonke noma izikhathi ukuze athuthukise ukuqhubeka.
ZihloleImibuzo Ecacisiwe yamamodeli e-AI

Kwenzekeni

Ithimba labacwaningi lenze isiphakamiso se-DSSG, uhlaka olusuka ekupheleni lwe-Source-Fully-Free Domain Adaptation yamamodeli olimi lombono. Le ndlela isebenzisa imifudlana yokuqondisa emibili—eyodwa esekelwe kumagama-ncazo akhiqiziwe futhi enye esekelwe kumahange ekilasi—ukulinganisa ukuzivumelanisa nesizinda esisha nokugcinwa kwencazelo yesigaba somhlaba wonke. Inguqulo ehlobene, i-DSSG-PAC, ngezikhathi ezithile ilinganisa kabusha amahange esibonelo futhi iwagcine phakathi kokulinganisa kabusha. Leli phepha lithi i-DSSG isebenze kahle kakhulu ngezindlela zamanje ezisezingeni eliphezulu kuwo wonke amabhentshimakhi amaningi, kuyilapho i-DSSG-PAC ilondoloze kakhulu lokho kusebenza nge-18.9% yesikhathi esiphelele sokujwayela.

Ukuphrinta ngaphambili, kuhanjiswe ku-arXiv ngo-Agasti 28, 2026, kugxile Ekuguqulelweni Kwesizinda Esigcwele Ngokugcwele Komthombo, noma i-SFF-DA. Iphepha lichaza lokhu njengokulungisa amamodeli olimi lombono ngaphandle kokufinyelela kudatha yomthombo noma amamodeli emithombo eqondene nomsebenzi othize. Isimangalo sayo esimaphakathi ukuthi lesi silungiselelo sidala inkinga "ye-dual semantic drift". I-Static drift ivela ekushumekeni kwekilasi okungaguquki okungenzeka kungavumelani nesizinda esisha, kuyilapho i-dynamic drift ivela kumagama-ncazo akhiqiziwe angahluka njengoba imodeli ijwayela. Ngokusho kwababhali, lezi zinkinga ziqinisa ukungezwani phakathi kwe-plasticity-ikhono lokufunda ulwazi oluthile lwesizinda-kanye nokuzinza-ikhono lokulondoloza izincazelo zesigaba esingaguquki.

I-DSSG, uhlaka oluhlongozwayo, luhlanganisa izinhlobo ezimbili zesiqondiso se-semantic. Ukusakazwa kwamagama-ncazo kuhloswe ngakho ukuthwebula ulwazi oluqondene nesizinda, kuyilapho ukusakaza kwehange ekilasini kuhloselwe ukulondoloza ukuvumelana kwezigaba zomhlaba. Leli phepha libiza le ndlela ehlanganisiwe ethi Dual Semantic Guidance, noma i-DSG. Futhi yethula i-Dynamic Cross-Modal , esebenzisa ukusatshalaliswa kothisha okuthuthukayo ukuze kulinganiswe ukuvumelana phakathi kwamamodeli othisha nabafundi. Umthombo uchaza lezi zingxenye njengengxenye yohlaka lokujwayela kusukela ekupheleni ukuya ekupheleni, kodwa awucacisi imodeli yezakhiwo, amasethi edatha, amashejuli okuqeqesha, noma izingxenyekazi zekhompyutha ezisetshenziswa ekuhloleni.

Ababhali babe sebenwebela i-DSSG ku-DSSG-PAC ngokulinganisa ngezikhathi ezithile amahange esibonelo futhi bawafake kunqolobane kuze kube ukulinganisa okulandelayo. Inhloso yabo eshiwo ukunciphisa ukubala okuphindaphindiwe kohlangothi lombhalo kuyilapho kugcinwa ikhono lesiqondiso sekilasi ukuzivumelanisa nezimo njengoba isikhala sombhalo sishintsha. Leli phepha liphinde lithi lisungula imingcele yengozi ye-SFF-DA exhumanisa ubungozi babafundi nekhwalithi yothisha nothisha kanye nokwehluka kothisha nabafundi. Ezivivinyweni zayo ezibikiwe, ababhali bathi i-DSSG iqhubekile nokusebenza yadlula izindlela zamanje ezisezingeni eliphezulu kuwo wonke amabhentshimakhi amaningi. Baphinde bathi i-DSSG-PAC ilondoloze kakhulu ukusebenza kokujwayela ngenkathi yehlisa isikhathi esiphelele sokujwayela ngo-18.9%. Umthombo awuwahlonzi amabhentshimakhi, izindlela zokuqhathanisa, amaphuzu aphelele, noma ukungaqiniseki kwezibalo.

Imininingwane yomthombo: arxiv.org ↗

Kungani kubalulekile

Amamodeli olimi lombono angase adinge ukusebenza kuzilungiselelo lapho idatha yawo yokuqeqeshwa yasekuqaleni noma imodeli yomthombo oqondene nomsebenzi othile ingakwazi ukufinyelelwa khona. Indlela ehlongozwayo ibhekana naleyo ngqinamba ngokuzama ukulungisa imodeli usebenzisa ulwazi lwesizinda esiqondiwe kuyilapho ikhawulela ukukhukhuleka kwe-semantic. Uma kukhiqizwe kabusha ngokuzimela, ukuncishiswa kwesikhathi okubikiwe kungenza ukulungisa okungenawo umthombo kungabizi kakhulu, nakuba umthombo unganikezi imininingwane eyanele yokuhlola ukuze kuhlolwe usayizi noma ukujwayelekile kwezinzuzo ezifunwayo.

Inkinga engokoqobo esingathwa yiphepha incane futhi icace kakhulu kunokushuna kwemodeli evamile. Esilungiselelweni esichaziwe, inhlangano ingase ibe nemodeli yolimi lombono kodwa iswele imvume, isitoreji, noma ukufinyelela kudatha kanye nemodeli eqondene nomsebenzi othile esetshenziswa esizindeni somthombo. Indlela engakwazi ukuzivumelanisa naleyo mikhawulo ingabaluleka lapho idatha yomthombo ingakwazi ukudluliselwa noma ukugcinwa. Indlela ehlongozwayo yakhelwe ngokuhambisana naleyo nkinga esikhundleni sokuphatha idatha yomthombo njengetholakala ngokuzenzakalelayo.

Umnikelo wezobuchwepheshe wephepha umzamo walo wokuphatha izidingo ezimbili eziqhudelanayo ngesikhathi esisodwa. Amagama-ncazo akhiqiziwe anganikeza ulwazi mayelana nesizinda esiqondiwe, kodwa ababhali baphikisa ngokuthi ukuthembela kuwo kuphela kungabangela ukukhukhuleka kwe-semantic. Ukushumeka kwekilasi okungaguquki kungagcina ukwakheka kwesigaba esizinzile, kodwa ababhali baphikisa ngokuthi kungase kuqine kakhulu esizindeni esishintshayo. Ukuhlanganisa amagama-ncazo kanye nokusakaza kwehange lekilasi kuvezwa njengendlela yokwengeza ukuguquguquka okuqondile okuqondiwe ngaphandle kokushiya ireferensi yesigaba esizinzile. Imingcele yobungozi ihloselwe ukwenza ngokusemthethweni ukuthi izinga likathisha we-semantic kanye negebe phakathi kukathisha nomfundi liyithinta kanjani ingozi yokujwayela.

Ukwehliswa okubikiwe ngo-18.9% esikhathini esiphelele sokujwayela kuwumphumela osobala kakhulu osebenzayo emthonjeni. Uma umphumela ubamba osayizi abahlukene bemodeli, izizinda, nokulungiselelwa kwezingxenyekazi zekhompuyutha, ukunciphisa ukubala okuphindaphindiwe kohlangothi lombhalo kungase kwehlise izindleko zokulungisa amasistimu olimi lombono. Kodwa-ke, umthombo awusho ukuthi ukulondoloza isikhathi kubonisa isikhathi sewashi, ukusetshenziswa kwekhompyutha, noma esinye isilinganiso, futhi awusho isisekelo lapho ukunciphisa kubalwe khona. Inzuzo yokusebenza efunwayo iphinde ibe umbiko wababhali kuphela ekubhalweni kwangaphambi kwesikhathi, ngakho-ke kufanele kuthathwe njengomphumela wocwaningo olindele ukukhiqizwa kunamandla embonini amisiwe.

Interactive Mechanism

I-Interactive Mechanism: Indlela Esebenza Ngayo Ngempela

Hlola ubuchwepheshe obuyisisekelo ngemuva kwalokhu kuthuthukiswa ngokuhlanganyela.

Document Size:128K tokens
Needle Placement Depth (Location in document):50% into text
Attention Context Buffer Map:
Target Fact (50%)
Equivalent Pages~320Standard book pages
Retrieval Accuracy99.9%Needle recall score
RAM / KV Cache5.1 GBMemory overhead
Prompt CachingActive~80% discount on reuse
Core takeaway: Million-token context windows allow querying whole codebases or legal archives in one prompt. However, KV cache memory scales with context length, making prompt caching crucial for real-time production.
I-Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Ongakubuka ngokulandelayo

Imibuzo elandelayo ebalulekile ngeyokuthi yimaphi amabhentshimakhi kanye nemigqa eyisisekelo esetshenzisiwe, ukuthi kungakanani ukunemba okushintshile ngaphansi kwe-DSSG-PAC, yiziphi izilungiselelo zehadiwe ne-adaptation ezikhiqize ukuncishiswa kwesikhathi ngo-18.9%, nokuthi ingabe indlela isebenza ngaphezu kwemisebenzi ehloliwe. Iphepha liyi-arXiv eliphrintiwe ngaphambili, futhi umthombo awunikezeli ukuqinisekiswa okuzimele, ubufakazi bokuthunyelwa, izibalo zokusebenza okuphelele, noma imininingwane mayelana nekhodi exhunyiwe. Lezo zikhala zinciphisa lokho okungaphethwa mayelana nokulungela okungokoqobo.

Okubalulekile kokuqala kokuqinisekisa irekhodi eligcwele lokuhlola. Umthombo uthi indlela ihlolwe kuwo wonke amabhentshimakhi amaningi, kodwa ayiwasho amagama noma ayichazi izizinda, amasethi edatha, amamethrikhi okuhlola, izindlela eziyisisekelo, noma ukulungiselelwa kwemodeli. Leyo mininingwane iyadingeka ukuze kunqunywe ukuthi izinzuzo ezibikiwe zibanzi noma zigxile emisebenzini ethile. Inkulumo ethi "izindlela zamanje zesimanje" nayo iyisimangalo sephepha, hhayi ukuqhathanisa okuzimele emthonjeni onikeziwe.

I-DSSG-PAC iqinisekisa ukuhlolwa okuhlukile ngoba isimangalo sayo sokusebenza kahle sibandakanya ukuhwebelana okuchazwa yi-abstract kuphela ngokokufaneleka. Ababhali bathi le ndlela igcina kakhulu ukusebenza kokuzivumelanisa nezimo ngenkathi inciphisa isikhathi esiphelele sokujwayela ngo-18.9%, kodwa ayinikezi ngokunemba okuhambisanayo noma izinombolo zobungozi. Ababuyekezi nabaqalisi bazodinga ukwazi ukuthi kangaki amahange esibonelo alinganiswa kabusha, kungakanani ukugcinwa kwesikhashana okuthinta ukusetshenziswa kwenkumbulo, nokuthi ingabe ukubala okuphansi kushintsha ukusebenza kwezizinda eziqondiwe ezinzima noma ezishintsha ngokushesha.

Ikhodi yephepha ichazwa njengetholakala nge-URL exhunywe i-arXiv, kodwa umthombo onikeziwe awuyiboni indawo yokugcina noma usungule ukuphelela kwayo, ilayisense, ukukhiqizwa kabusha, noma isimo sokunakekelwa. Umsebenzi owengeziwe kufanele futhi uhlole ukuthi ingabe imingcele yengozi ibikezela ukuziphatha okubonwayo nokuthi ingabe indlela ihlala isebenza kahle uma amagama-ncazo akhiqiziwe enekhwalithi ephansi noma izigaba zekilasi zingacacile. Kuze kube yilapho leyo mibuzo iphendulwa, umbhalo wangaphambili usekela ukubika uhlaka olusha oluhlongozwayo lokuzivumelanisa nezimo nezimangalo ezilinganiselwe zababhali balo, kodwa hhayi iziphetho mayelana nokulungela ukukhiqiza noma ukuphakama kwendawo yonke.

Imihlahlandlela ehlobene nemibuzo

Amamodeli e-AI AchaziweAma-TransformersUkuqeqeshwa kwe-AIYini i-AI?Hlola okwaziyo — zama imibuzo ye-AI yamahhalaBheka igama le-AI kuhlu lwethu lwamagamaLandela i-tracker yokukhishwa kwemodeli ye-AI
Uthole lokhu kuwusizo?