Xiga xigaHagaha xiga
Recall, Precision and Elusion Testing in Document Review
Farsamo
Tilmaamaha aasaasiga ah
Saxnaanta iyo dib u xasuusashadu waa laba cabbir oo is kaaba ah oo lagu qiimeeyo kala-saarayaasha, gaar ahaan marka fasalladu isku dheeli tiran yihiin.
Dhageyso hagahanAI-waa laga sheekeeyay · ~2 min
Together they reveal what plain accuracy hides — how often a model's positive predictions are right, and how many real positives it actually catches.
Marka tusaaluhu u calaamadiyo shayada sida togan, laba su'aalood ayaa muhiim ah. Saxnimadu waxay ku wayddiinaysaa: wax kasta oo aanu calaamadnay, intee in le'eg ayaa run ahaantii wanaagsanaa? Waxay la mid tahay xaqiiqooyinka dhabta ah ee ay u qaybsan yihiin dhammaan waxyaalihii la saadaaliyay, iyaga oo ciqaabaya digniinaha beenta ah. Xusuusnow (xasaasiyad) waxay weyddiinaysaa: dhammaan xaqiiqooyinka dhabta ah ee jira, imisa ayaanu qabannay? Waxay la mid tahay xaqiiqooyinka dhabta ah ee loo qaybiyay dhammaan wanaagga dhabta ah, ciqaabaya khasaarooyinka. Kuwani badanaa way isweydaarsadaan: hoos u dhigista heerka go'aanka waxay soo jiidataa faa'iidooyin badan (xusuusinta sare) laakiin waxay calaamadeysaa junk badan (sax hoose), iyo lidka ku ah. Kaas oo mudnaanta la siinayo waxay ku xiran tahay kharashyada - shaandhada spam waxay u roon tahay saxnaanta (ha qashinka ku dhejin boostada dhabta ah), halka shaashadda kansarka ay jeceshahay in la xasuusto (ha moogaan buro). Dhibcaha F1, celceliskooda iswaafajinta, waxay isku dheellitirayaan labadaba hal lambar.
Spam waxay shaandheysaa saxnaanta sare sidaa darteed iimaylada sharciga ah ku dhawaad weligood si khaldan looguma dirin galka spamka.
Tijaabada baadhista caafimaadku waxay mudnaan siiyaan dib u soo celinta sare si looga fogaado bukaanada maqan ee dhab ahaantii qaba cudurka, aqbala waxyaabo badan oo been abuur ah oo dabagal ah.
Nidaamyada raadinta iyo talooyinka waxay ka warbixiyaan precision@k (immisa ka mid ah natiijooyinka k ugu sarreeya ayaa khuseeya) si loo cabbiro tayada darajada.
Ogaanshaha khayaanada waxay dheellitirtaa saxnaanta iyo dib u soo celinta dhibcaha F1, maadaama labadaba digniinaha beenta ah iyo khiyaanada la seegay ay qaali yihiin.
Maaddaama AI ay soo gasho xayndaabyada sare-u-qaadista - ogaanshaha caafimaadka, dhexdhexaadinta nuxurka, khiyaanada - kooxuhu waxay si isa soo taraysa uga warbixiyaan saxnaanta iyo dib u soo celinta (iyo qaloocadooda) halkii ay ka ahaan lahaayeen sax ahaansho kali ah, oo ay hagaajiyaan heerarka si ay ula jaan qaadaan kharashyada dhabta ah ee adduunka iyo caqabadaha caddaaladda. Xisaabinta saxnaanta/xusuusinta koox kasta waxay noqonaysaa halbeeg lagu ogaanayo heerarka khaladaadka kala duwan ee tirakoobyada. Filo cabbirada xasaasiga ah ee qani ka ah, ixtimaalka la jaanqaadaya, iyo qalabaynta u saamaxaysa daneeyayaasha inay si isdhexgal ah u doortaan dhibcaha hawlgalka halkii ay aqbali lahaayeen heerka caadiga ah ee 0.5.
Warqad bilaash ah
Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.
Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.
Is tijaabi
Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.
Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq
Saxnaanta iyo dib u xasuusashadu waa laba cabbir oo is kaaba ah oo lagu qiimeeyo kala-saarayaasha, gaar ahaan marka fasalladu isku dheeli tiran yihiin. Waxay si wada jir ah u muujinayaan waxa saxnaanta cadi qarinayso - inta jeer ee tusaalaha saadaasha wanaagsani ay sax yihiin, iyo inta xaqiiqo ee dhabta ah ee ay dhab ahaantii qabato.
Saxnaanta = TP / (TP + FP) waxay cabbirtaa saxnaanta saadaasha tusaalaha - sida lagu kalsoon yahay calanka togan.
Lowering the threshold expands or preserves the predicted-positive set. It may catch additional true positives and additional false positives; changes depend on which items cross the threshold.
Accuracy can be dominated by correct negative predictions. Precision and recall examine positive flags and missed positives using TP, FP, and FN.
Precision@10 measures the relevant fraction among the top ten results: 6/10 = 60%.
Sii wad waxbarashada
Tilmaamayaal badan ayaa loo doortay mawduucan
Xiga xigaHagaha xiga
Recall, Precision and Elusion Testing in Document Review
Farsamo