DalšíDalší průvodce
Analýza rozložení dokumentu
Vizuální AI
Vizuální průvodce AI
Donut (Document Understanding Transformer) is an OCR-free visual document-understanding model that maps document images directly to text or structured outputs without first calling a separate OCR engine.
Poslechněte si tento návodAI-vyprávěný · ~3 min
The original research describes a Transformer encoder-decoder evaluated on document classification, information extraction, and visual question answering tasks. OCR-free does not mean error-free: outputs depend on training data, document layout, language, image quality, and the task prompt.
Many document-understanding systems use a pipeline: OCR first extracts text, then another model classifies, summarizes, or extracts fields from that text. Donut, short for Document Understanding Transformer, was proposed as an OCR-free alternative that processes a document image directly with an encoder-decoder Transformer. The original paper presents tasks including document image classification, information extraction, and visual question answering. It argues this design can avoid separate OCR errors propagating into later processing and can be trained across domains and languages with synthetic data. “OCR-free” describes the system architecture, not the guarantee that text is read perfectly. A direct image-to-sequence model may still miss small print, confuse similar symbols, mis-handle a new layout, or produce a plausible but unsupported field. Its outputs depend on the particular checkpoint, task prompt, preprocessing, fine-tuning set, and target format. The original paper reports benchmark results for its tested models and datasets; those numbers should not be transferred automatically to different documents or deployments. For a practical system, define the fields and acceptable error rates, evaluate on representative documents not used for training, and preserve a human review path for high-impact values. Check extracted fields against the visible image and source records. Compare against an OCR-plus-model baseline where that is relevant; end-to-end simplicity does not guarantee lower cost or higher accuracy in every task. Donut is one model family for visual document understanding, not a universal replacement for OCR engines or document-specific validation.
A receipt-parsing system fine-tunes Donut to produce structured fields from a document image, then checks totals and dates against the source.
A researcher compares a Donut pipeline with an OCR-plus-understanding pipeline on a held-out set of receipts and forms.
A document question-answering demo prompts a fine-tuned model to answer a question using an image of a conference schedule.
A team reviews low-quality scans and unfamiliar layouts because a model can omit or invent fields without a separate OCR transcript to inspect.
OCR-free document models may broaden languages and document types as training data and model architectures improve. Hybrid pipelines may still be preferable where explicit text extraction, auditability, or specialized OCR is needed. Teams should compare approaches on their own document distribution and retain source images and verification for important fields. A single benchmark does not establish deployment readiness. Future versions should be reevaluated on fresh, representative forms because layouts, languages, and operational requirements change. Track model, prompt, preprocessing, and schema versions alongside each evaluation.
Newsletter zdarma
Tři ověřené příběhy ze světa AI každý všední den ráno, psané srozumitelnou angličtinou. Navždy zdarma, bez reklam.
Jeden e-mail každý všední den. Odhlásit se můžete jedním kliknutím. Vaši adresu nikdy neprodáváme ani nesdílíme.
Otestujte se
Okamžitá zpětná vazba ke každé odpovědi a sdílitelný certifikát s ověřitelným ID po absolvování kurzu.
Podpořte bezplatnou AI vzdělávání. AI Understanding je nezisková organizace 501(c)(3) — žádné reklamy, žádná platba za přístup, nikdy. Darujte
Donut (Document Understanding Transformer) is an OCR-free visual document-understanding model that maps document images directly to text or structured outputs without first calling a separate OCR engine. The original research describes a Transformer encoder-decoder evaluated on document classification, information extraction, and visual question answering tasks. OCR-free does not mean error-free: outputs depend on training data, document layout, language, image quality, and the task prompt.
Donut was proposed as an end-to-end image-to-text document model.
Donut documentation describes an image encoder and text decoder.
The paper motivates OCR-free processing partly to avoid error propagation from OCR.
OCR-free models can still make recognition and generation errors.
An end-to-end model may not expose intermediate recognized text.
Učte se dál
Pro toto téma bylo vybráno více průvodců
DalšíDalší průvodce
Analýza rozložení dokumentu
Vizuální AI