Dellu ci xibaar yi
YeesalAI Understanding

Jàngat biy waaja am dafa wane ni LLM jaar na yoon ci laaji registre clinique yu jaxasoo

Gëstu bu lalu ci sit yu bari dafa wane ni xeetu làkk bu yaatu méngoo na ak 87% ci tontu yu nit ñi déggoo suñuy jëlee xibaar ci done pajum yuñ defaruwul, waaye njubte gi daanu ba 62% ci laaj yiy laaj waxtu xew-xew bi ak xalaat klinik bu gëna mag.

5 min readRead the primary source
Source-page capture accompanying Prospective study finds LLM accuracy falls sharply on ambiguous clinical registry questions
Këyitu xët bu njëkkSource biñ enregistre
Siiwalkat
arxiv.org
Lëkkalekaayu cosaan
arxiv.orghttps://arxiv.org/abs/2608.20373
Xeetu balluwaay
Këyitu njëkk - ab yëgle ofisel, këyit, dosiye, wala xëtu pàrti bu njëkk bi ñuy jàng ci saasi.
KontekstXam lii ci 60 seconde

Tambalil fii

Term yu am solo

Modelu làkk bu mag (LLM)
Benn xeetu làkk buñ tàggat ci corpus mbind yu bari ngir sos ak jàngat mbind.
Dëgg bu Suuf
Etiketu royuwaay yiñ mëna wóolu ngir tàggat wala jàngat modelu génne yi.
Nattal sa boppModèlu IA leeral quiz

Lu xew

Gëstukat yi jàngat nañu benn xeetu làkk bu yaatu ci abstraksioŋu registre clinique ci jëfandikoo ay done elektronik yuñ defaruwul yu bawoo ci ñaari jekkal Registre Done Cardiovasculaire bu Daara bu Kawe bu Amerique bu Kardioloji. Gëstu bi dafa xaaj laaji registry yi ci 6 kategori yu lalu ci lu dese leer ak sababi klinik yiñ soxla ngir tontu leen.

Këyit bi, ñu xoolaat ci arXiv ci 25 ut, dafa wax ci benn pilote ak benn jàngat bu lalu ci laaji registre klinik yu bawoo ci Registre Done Cardiovasculaire bu College of Cardiology bu Amerique. Ci biir pilote bi ci santu pajum akademik, xeetu paj mi dafa xàmmee balluwaayi done yi ci laaj bu nekk ci registry bi. Abstracteur yu am xam-xam jëfandikoo nañu resultaa yi ngir joxe leeral ci dokimaa yu jëm ci laaj yi. Ci jàngat bi ñu amal ci ñaareelu santar, ñu jëfandikoo ñaareelu registre ACC NCDR, model bi tontu na laaj yi ci ensemble yooyu. Nafar bi dafa lalu ci jàngat bi ci génne ak tekki xibaar yi ci dosiye pajum yi fi nekk, du ci tablo done yuñ tànn bu njëkk.

Laata ñuy xoolaat génne model, ñaari abstractors moom seen bopp taxawal dëgg gi ci suuf, ba noppi jox laaj bu nekk benn ci jiroom benn kategori: Garabu / Daara Xew-xew, Presence Clinique Binary, Administratif, Laboratoire / Physiologic, Tekki Klinik, ak Waxtu Xew-xew. Ñu ngi raññe kategori yi ci lu leerul ak xalaat klinik bi war ngir saafara laaj bu nekk. Këyit dafa wax ni 9,430 tontu abstractor boole ci 4,715 tontu consensus, boole ci 501 tontu pilote ak 4,214 tontu validation. Ci pilote bi, limu boroom done yiñ tànn mingi tàmbalee ci 14.6 ci wàllu demografi ba ci 89.2 ci wàllu taarix ak fakteer risk, ak coppite yu am solo yuñ gis ci deviation standard yiñ xamle.

Ci wàllu firnde, déggoo bi am ci diggante nit ñi tolluwoon na ci 98%, buñu sukkandikoo ci jàngat bi. Tontu LLM yi méngoo nañu bu baax ak deggoo ci 87% ci mbir yi, dañu leen jàppee ni méngoo yu xaaj ci 2%, te méngoowul ci 9%. Këyit dafa wane ni 91,5 ci teemeer boo jél ci laaj yi, ak 13,4 ci teemeer boo jél ci 157 laaj, bu nekk ci ñoom am 20 tontu. Jaar-jaar bi dafa wuute ci kategori ambiguïté, wàññeeku joge ci 96% ngir garab / Event Flag laaj ba 62% ngir Event Timing laaj. Boroom bi dafay wane ni jàngat bi dafa njëkka imprime te waxul xeetu jàngat biñ jàngat ci abstract bi.

Ay leeral ci cosaan: arxiv.org ↗

Lu tax mu am solo

Resultaa yi dañuy wane ni njubte bu yam mën na nëbb ñakk kattan yu am solo yi ci wàllu faju IA. Royuwaay bi dafa gëna mëna def ci garab yu direct ak laaj yi jëm ci xew-xew, te gëna bon su amee luñu wara tekki ci wàllu paj wala xam kañ la xew-xew bi amee.

Li gëna am solo ci li ñu gis du ni LLM def njuumte rek. Mooy performance bi dafa wàññeeku ci anam wu jaar yoon ndax laaj yi dañu gëna ñàkk leer, ba noppi di gëna laaj xalaat yu klinik. Kon benn lim bu mat sëkk bu tollu ci 91,5% mën na joxe leeral yu mat sëkk ci risku liggéey bi. Liggéeyu registry bu am barab yu bari yu jub mën na nuru lu wóor te ba leegi mingi def lu baaxul ci ay laaj yu ndaw yuy laaj tabaxaat contexte, tekki firnde klinik, wala def benn xew-xew ci jamono.

Registre clinique yi dañuy jàppale gëstu yi, natt kalite bi, benchmarking yi ak yeneen xeeti rapoor ci wàllu faju. Jumtukaay yi ci abstraction mën nañu indi jafe-jafe ci kalite dokimaa yi ci suuf doonte sistem bi deful diagnostic wala tegtal pajum. Gap bi ñu xamle ci diggante lu tollu ci 98% ci déggoob nit ñi ak tolluwaayu gëna néew ci model bi dafay wane ni xoolaat nit ñi dafa am solo ci liggéey bii, rawatina fu tontu bi aju ci këyitu dokimaa yu bari wala ci tekki li xew-xew yi toppalante.

Gëstu bi dafay joxe itam anam wu baax wu ñuy jàngat misaali làkki faju: xaaj laaj yi ci xeetu jaxasoo bi ci nekk, moo gën ñu jàppee bépp liggéey buy génne ay mbir ni luy benn. Xeetu liggéey boobu mën na jàppale mbootaay yi ñu xam ban wàll lañu wara jàppale ak ban wàll lañu wara gëna xoolaat. Source bi wanewul ni model bi dafa gaañ malaad bi, gëna yombal liggéeyu registre bi, wàññi njëg yi, wala ñu jëfandikoo ko ci paj mi ñuy faral di def. Ba leegi kenn xamul njariñ yooyu.

Interactive Mechanism

Mekanism buy weccoo xalaat: naka lay doxee

Saytu xarala yu bees yi ci ginaaw yokkute bii ci anam wu weccoo xalaat.

Thinking Budget (Test-Time Tokens):1,024 tokens
Complex Accuracy79%Math & Code Logic
Latency3.2sTime to first full output
Inference Cost$0.0092Per query estimated
Reasoning StyleStep VerificationInternal chain depth
Active Thinking Trace:
1Deconstruct user problem into formal constraints
2Propose candidate hypotheses & step-by-step calculation
3Self-correction: Backtrack and refute subtle edge cases
4Exhaustive consistency check & final output synthesis
Core takeaway: Test-time compute fundamentally changes AI economics. Instead of only scaling during pre-training, giving reasoning models more tokens at inference time allows them to systematically solve PhD-level STEM problems.
Saytu konsept buy weccoo xalaat+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Li nga wara seetaan ci topp

Gëstu bi wanewul ndax li ñu gis mën nañu ko jëfandikoo ci yeneen xeetu paj, hopitaal, spesialisasioŋ ci wàllu pajum, registre, wala jël yenn dogal ci wàllu paj. Beneen liggéey bi dafa wara natt jekkal yu gëna yaatu, méngale xeetu model yi, xoolaat li njuumte yu ndaw yi mëna jur, ba noppi xool ndax jàngat nit mën na jàpp njuumte yi gëna tar ci anam wu wóor.

Li gëna am solo buñu xamul mooy naka la resultaa yi di doxee ci àdduna bi yépp. Source bi dafay nettali pilote ci benn santar medikaal akademik ak validasioŋ ci ñaareelu santar bi jëfandikoo beneen registre ACC NCDR, waaye joxewul firnde ci abstract bi ci hopitaal yu askan wi, yeneen specialité, sistem yu wuute, wala yeneen jëmmal registre. Royuwaay biñ jàngat itam xamu ñu ko ci abstract bi. Dina ñu soxla ñu méngale ay model ak ay model model balaa ñuy jël doggal ci wàllu LLM ci anam wu ëpp solo.

Evaluation yi ci kanam war nañu joxe lu ëpp njubteg match agrégat bi. Laaj yu am solo yi ñooy ndax tontu yu xaaj yi mën nañu leen jëfandikoo ci wàllu paj, ban xeetu njuumte ñoo gëna bari, ñaata yoon njuumte yi di am ci bis yi wala dokimaa yu wuute, ak ndax jàngat yi mën nañu gis njuumte yi ci anam wu méngoo. Resultaa yi bawoo ci kategori yi ci jàngat bi dañu tax Event Timing nekk barab bu am solo ngir topp, waaye source bi leeralul laaj yi, misaali njuumte, wala metit wi tontu yu jaarul yoon.

Xamu ñu itam ndax tànneefu kàndidaa-source model bi ci pilote bi amna njeexital ci liggéeyu validasioŋ bi ci ginaaw wala ndax liggéey bu noonu mel dina am sudee abstractors yu am xam-xam duñu defar ensemble dokimaa. Yokkug njàngale mën na saytu dokimaa yuñ defaruwul, bariwaayu ndimmbalu nit, ak di wottu ëlëg ci liggéeyu registre dëgg. Ba firnde yu mel noonu am, li ñu gis dafay jàppale nit ñi ñu teg seen bopp ci liggéey yu abstraction yu leer, duñu wax ni LLMs mën nañu wecci abstractors clinique. Kon balluwaay bi dafay bàyyi ubbeeku ci ni benn gis-gis bi di doxee sudee abstracteur yu am xam-xam ñoo jiite tànneefu këyitu dokimaa, sudee dokimaa yi dañu am niveau yu wuute ci structure, wala sudee jàngat yi dugg ci liggéey bi ci ay poñ yu wuute.

Gid ak quiz yu ci méngoo

Model IA leeral nañu koJikko yu AITaggat ci IAChatGPT & LLMsNatt li nga xam — natt quiz IA bu amul faydaSeetal benn baat IA ci sunu glossaireToppal toppukaayu génne xeetu IA
Gis nga lii am njariñ?