Kediska Cohen ee Kappa

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

1. Laba falanqeeye ayaa arkay heshiiska 0.8 iyo heshiiska la filayo ee 0.5. Qiime kappa kee ayaa raacaya?
   • 0.3
   • 0.4
   • 0.8
   • 0.6
2. One annotator uses a category 60% of the time and the other uses it 50% of the time. How much does that category contribute to expected agreement?
   • 0.10
   • 0.30
   • 0.55
   • 1.10
3. Waa maxay sababta heshiiska la filayo ee kappa uu u caddayn waayay in falanqeeyayaashu ay si aan kala sooc lahayn u qiyaasayeen?
   • It is calculated from the number of disagreements alone
   • It is identical to the observed agreement for every dataset
   • It is a reference derived from label frequencies, not an observation of their reasoning
   • It assumes every category must have equal frequency
4. Darnaanta shilka hoose, dhexe iyo sare, maxay kooxdu u dooran kartaa kappa miisaan leh?
   • To give different penalties to one-level and two-level disagreements
   • To remove all disagreements from the calculation
   • To guarantee a higher reliability score
   • To avoid specifying a category order
5. Labada falanqeeye waxay kiis kasta ku meeleeyaan qayb isku mid ah. Waa maxay sababta kappa caadiga ah aan loogu soo wargelin inay tahay guul la isku halleyn karo oo toos ah?
   • Perfect raw agreement automatically makes kappa one
   • The score ignores the common category and evaluates only disagreements
   • Subtracting expected agreement alone gives a complete kappa calculation
   • Expected agreement is one, leaving a zero denominator
6. Dib u eegis labaad ayaa koobiyaya summadaha dib u eegista koowaad oo waxa uu gaadhay heshiis qumman. Gabagabo kee baa xaq ah?
   • The labels have been independently validated
   • The agreement does not establish independent reliability
   • Every label is necessarily correct
   • The dataset can be used without checking instructions
7. Which accompanying information helps interpret a kappa score when category frequencies are uneven?
   • Only the raw agreement percentage, without category counts
   • Only whether kappa exceeds a universal cutoff
   • Sample size, raw agreement and the agreement table
   • Only the weighted score, without specifying category order
8. Two annotators both follow a mistaken rule and agree strongly. What does their high kappa fail to establish?
   • That their labels are factually correct
   • That their observed agreement exceeds its frequency-based expectation
   • That they used the same labels on many cases
   • That their assignments show consistency under the shared rule