ニュースに戻る
産業AI Understanding ブリーフィング

カカオ、AI Safety Instituteと提携し、3段階のAIモデルとエージェントの安全性検証を開始

カカオは、言語モデルと AI エージェントの安全性を共同で評価するために AI Safety Institute と MOU を締結し、3 段階の評価プロセスと評価ツールを共同開発する計画を概説しました。

4 min readRead the original reporting
Source-provided image accompanying Kakao partners with AI Safety Institute to launch three‑stage AI model and agent safety verification
帰属に応じたレポート記録されたソース
出版社
it.chosun.com
ソースリンク
it.chosun.comhttps://it.chosun.com/news/articleView.html?idxno=2023092170991
ソースの種類
報道機関による報道であり、自社の文書ではありません。

独自に確認できなかったもの: この主張は、指定されたアウトレットに起因します。第三者の文書と照合して検証しませんでした。 (it.chosun.com)

コンテキスト60秒で理解できる

ここから始めましょう

重要な用語

AIの安全性
AI システムにおける有害な動作、障害、誤用のリスクを軽減することに重点を置いた分野。
ベンチマーク
モデルのパフォーマンスを測定および比較するために使用される標準化されたテストまたはデータセット。
自分自身をテストしてくださいAI倫理クイズ

何が起こったのか

Kakao announced that it has signed a memorandum of understanding (MOU) with the Institute on September 28, 2026, to jointly evaluate the safety of its AI models and agents. Under the agreement, Kakao will provide its AI models—including the in‑house language model ‘Kanana‑1.5‑9.8B’—and AI agents for assessment, as well as the infrastructure needed for testing. The AI Safety Institute will conduct the evaluations and work on advancing the assessment methodology. The partnership defines a three‑stage safety verification roadmap: Stage 1 focuses on pre‑ and post‑deployment safety of language models; Stage 2 expands the scope to multimodal language models and AI agents; and Stage 3 aims to co‑create proprietary evaluation tools that can independently verify model and agent safety. The MOU builds on a prior joint safety assessment of Kakao’s Kanana model, which the institute reported performed comparably to overseas models of similar scale.

On September 28, 2026, Kakao and the Institute signed an MOU to jointly evaluate the safety of Kakao’s AI models and agents, according to a report by IT조선. The agreement outlines responsibilities for each party: Kakao will supply the AI models and agents slated for assessment and provide the necessary infrastructure, while the institute will carry out the safety evaluations and refine the assessment methodology.

The partnership builds on a prior joint safety assessment of Kakao’s proprietary language model, Kanana‑1.5‑9.8B, which the institute said performed at a high safety level compared with similarly sized overseas models. The new MOU expands the scope to include multimodal language models and AI agents, and sets a three‑stage verification plan that culminates in the co‑development of an independent safety assessment tool.

The three‑stage plan is structured as follows: Stage 1 evaluates pre‑deployment and post‑deployment safety of language models; Stage 2 adds multimodal language models and AI agents to the evaluation pool; Stage 3 focuses on creating a joint assessment tool that can independently verify safety for both models and agents. Both parties intend to review the assessment outcomes together and later decide on the extent of public disclosure.

ソースの詳細: it.chosun.com ↗

なぜそれが重要なのか

The collaboration signals a growing emphasis on systematic safety testing for AI systems beyond text‑only models, extending to multimodal and agent‑based applications. By involving an external research institute, Kakao seeks to add independent credibility to its safety claims, which could influence user trust and regulatory scrutiny in South Korea’s rapidly expanding AI market. The three‑stage framework may serve as a template for other Korean firms seeking to formalize safety evaluations, potentially shaping industry standards and informing future policy discussions on AI risk mitigation. Moreover, the joint development of assessment tools could lower barriers for smaller developers to conduct rigorous safety checks, fostering broader adoption of best‑practice safety protocols.

The initiative reflects a broader industry shift toward rigorous safety testing for AI systems that go beyond text generation, addressing emerging risks associated with multimodal inputs and autonomous agents. By partnering with an external institute, Kakao aims to add an independent layer of validation, which can bolster user confidence and pre‑empt regulatory concerns.

The three‑stage framework could become a de‑facto for Korean AI developers, encouraging the adoption of systematic safety protocols across the sector. This may influence future policy formulation, as regulators often look to industry‑led standards when drafting guidelines.

Co‑developing assessment tools may democratize safety testing, allowing smaller firms without extensive resources to evaluate their models against consistent criteria. This could lead to higher overall safety standards in the Korean AI ecosystem.

Interactive Mechanism

インタラクティブなメカニズム: 実際にどのように機能するか

この開発の背後にある基盤となるテクノロジーをインタラクティブに探索します。

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
インタラクティブコンセプトチェック+10 Points
AI Ethics Quiz

Impossibility results in algorithmic fairness (e.g. Kleinberg et al., Chouldechova) show what?

次に見るべきもの

Future updates from the partnership will reveal the specific metrics and benchmarks used in each verification stage, as well as the timeline for releasing the co‑developed evaluation tools. Observers should monitor whether the assessment results are publicly disclosed and how they compare to international safety standards. Additionally, the impact of this collaboration on Kakao’s product roadmap—such as the deployment of AI agents in its messaging and search services—will indicate how safety considerations are integrated into commercial rollouts. Regulatory bodies may also reference this MOU when drafting guidelines for testing in Korea.

The timeline for releasing the jointly developed safety assessment tool and the specific evaluation metrics will be critical to gauge the partnership’s practical impact.

Whether the assessment results will be made public, and how they compare with international safety benchmarks, will indicate the transparency and rigor of the process.

Regulatory responses in South Korea, such as potential incorporation of the three‑stage framework into official guidelines, will be a key indicator of the partnership’s influence on policy.

The rollout of AI agents in Kakao’s consumer services, and how safety findings shape their deployment, will provide concrete evidence of the collaboration’s effect on product development.

関連ガイドとクイズ

AI倫理AI モデルの説明AIエージェントあなたが知っていることをテストする - 無料の AI クイズに挑戦してください用語集で AI 用語を検索するAI 資金調達トラッカーをフォローする
これは役に立ちましたか?