Back to News
InnovationAI Understanding briefing

Kakao open-sources Kanana vision encoders for multimodal AI

Kakao released two open-source vision encoder models, Kanana-2-Vision Encoder Medium and Tiny, on Hugging Face, claiming top performance on 42 benchmarks against major global competitors.

4 min readRead the original reporting
Source-provided image accompanying Kakao open-sources Kanana vision encoders for multimodal AI
Attributed reportingSource recorded
Publisher
biz.chosun.com
Source type
Reporting by a news outlet — not a first-party document.

What we could not confirm independently: This claim is attributed to the named outlet. We did not verify it against a first-party document. (biz.chosun.com)

ContextUnderstand this in 60 seconds

Key terms

OCR (Optical Character Recognition)
Technology that converts text in images or scans into machine-readable text.
Foundation Model
A large pre-trained model that can be adapted to many downstream tasks.
On-Device AI
AI inference performed locally on user hardware rather than in a remote cloud service.

What happened

Kakao released two self-developed vision encoder models, Kanana-2-Vision Encoder Medium (426M parameters) and Tiny (98M parameters), as open source on Hugging Face under a license permitting commercial use. The company reported that these models achieved top performance across 42 benchmarks, surpassing vision encoders from Google, Meta, Apple, and Alibaba, with the Tiny model showing particular strength in Korean text recognition and document understanding.

Kakao announced on October 21 that it has released two of its self-developed 'Kanana-2-Vision Encoder' models as open source on Hugging Face. The two models are the 'Medium' version, which has 426 million parameters, and the 'Tiny' version, which has 98 million parameters.

A vision encoder functions as the visual interface for AI systems, extracting features such as objects, text, and shapes from images to pass to a language model. Kakao evaluated these models across nine areas, including general visual question answering, English and Korean text recognition, document understanding, and in-image localization, totaling 42 benchmarks.

According to Chosunbiz, the Kanana models achieved top performance, surpassing major global vision encoders including Google SigLIP2, Meta Perception Encoder, Apple AIMv2, and Alibaba Qwen3.5-ViT. The Tiny model, despite having fewer than 100 million parameters, showed performance gaps in its favor compared to global models exceeding 400 million parameters, particularly in Korean exams and text recognition.

The models were released under the Kanana open license, which allows for both research and commercial use. Noh Byung-seok, performance lead for Kakao's Unified , stated that the role of vision encoders is increasingly important in the era of agentic AI and 'computer use' technology, which requires accurate analysis of high-resolution screens.

Source details: biz.chosun.com ↗

Why it matters

Vision encoders are critical components for multimodal AI, acting as the 'eyes' that extract visual features for language models to interpret. By open-sourcing high-performing encoders, Kakao provides the AI community with accessible tools that can improve the accuracy of image-based tasks such as OCR and document analysis. This is particularly significant for applications, where the lightweight Tiny model can operate efficiently without heavy computational resources, potentially lowering the barrier for developers to build robust multimodal systems.

Vision encoders are a foundational component of multimodal AI, determining how accurately an AI system can interpret visual data. Historically, this space has been dominated by proprietary models from major tech companies, limiting access for independent developers and smaller organizations.

By open-sourcing these models, Kakao provides a viable alternative that is explicitly licensed for commercial use. This allows businesses and researchers to integrate high-performance visual understanding into their products without relying on closed-source APIs or facing restrictive licensing terms.

The emphasis on the Tiny model's performance in Korean text recognition and document understanding highlights a specific utility for regional applications. This is particularly relevant for , where computational constraints require lightweight models that can still handle complex visual tasks like OCR efficiently.

The release contributes to the broader trend of open-weight AI development, potentially accelerating innovation in multimodal systems by providing a strong baseline for further research and application development.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
What is AI? Quiz

A route planner searches possible journeys using explicit rules. What does this illustrate about AI?

What to watch next

Developers and researchers will likely test these models in real-world multimodal applications to verify the reported benchmark claims. The adoption of the Tiny model in products will be a key indicator of its practical utility. Additionally, the competitive landscape for open-source vision components may shift as other companies respond to Kakao's release.

Independent verification of the benchmark results will be crucial, as the performance claims are currently based on Kakao's internal evaluations. Third-party testing will determine if the models maintain their lead in real-world scenarios.

The adoption of the Tiny model in applications will be a key metric for its success. If developers find it effective for mobile or edge computing tasks, it could become a standard component in multimodal pipelines.

The competitive response from other major tech companies and AI startups will be important to monitor. The release of high-performing open-source vision encoders may prompt further releases or updates from competitors to maintain their market position.

Related guides & quizzes

Found this useful?