quiz bu lëkkale ak tegtal · Diggante Niveau

OCR Accuracy: Character and Word Error Rate Quiz

Tests CER and WER definitions, normalization and tokenization choices, and why aggregate OCR error rates need task-specific document checks.

Yooni njiit yu jëm ciOcr Accuracy Character Error Rate
Laaj 1 de 8

How is character error rate commonly calculated?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. How is character error rate commonly calculated?
    • (Substitutions + deletions + insertions) divided by the number of reference characters
    • Correct characters divided by the number of recognized characters
    • The number of reference words divided by total edits
    • Substitutions only divided by the number of reference characters
  2. How does WER differ from CER?
    • It uses the recognized words as the denominator in all cases
    • It measures semantic similarity rather than edit distance
    • It counts edit operations at the word level and divides by reference words
    • It measures only punctuation differences
  3. Why can CER or WER exceed 1.0?
    • Substitutions and deletions alone can exceed the reference length even without insertions
    • Character error rate divides edits by the number of recognized characters
    • Whitespace normalization can make a score exceed one even when the edit count is smaller than the reference
    • A large number of insertions can make the edit count exceed reference length
  4. Which normalization policy makes a CER comparison reproducible across systems?
    • Lowercase strings but leave punctuation, whitespace, and Unicode handling unspecified
    • The exact Unicode, punctuation, and whitespace transformations applied consistently to the reference and output
    • Remove punctuation from the reference but preserve it in the recognized output
    • Normalize only the recognized output while leaving the reference transcript unchanged
  5. Why might WER comparisons be difficult across languages?
    • WER does not use text tokens
    • All languages define whitespace-delimited words identically
    • WER ignores reference text length
    • Word segmentation and tokenization rules can differ across scripts and languages
  6. What can a low overall CER hide in a document workflow?
    • A critical error in a short identifier, total, or table field
    • That every character was substituted
    • That reference normalization was not used
    • That OCR has no impact on downstream extraction
  7. How should two OCR systems be compared fairly?
    • Compare training loss from one model with test CER from another
    • Choose different reference documents so each system sees its best case
    • Use the same reference set, normalization, tokenization, and scoring implementation
    • Use each system’s preferred normalization and compare raw scores
  8. For invoices, which measure checks whether dates or totals are correct as complete fields beyond CER or WER?
    • Table-cell boundary alignment for the page layout
    • Field-level correctness for extracted dates, totals, and identifiers
    • Per-document mean character error rate
    • Confidence calibration for individual character predictions