Назад до новин
ПромисловістьAI Understanding брифінг

Kakao співпрацює з Інститутом безпеки штучного інтелекту, щоб запустити триетапну модель ШІ та перевірку безпеки агента

Kakao підписав меморандум про взаєморозуміння з Інститутом безпеки штучного інтелекту для спільної оцінки безпеки своїх мовних моделей і агентів штучного інтелекту, окресливши трифазний процес оцінки та плануючи спільну розробку інструментів оцінювання.

4 min readRead the original reporting
Source-provided image accompanying Kakao partners with AI Safety Institute to launch three‑stage AI model and agent safety verification
Атрибутована звітністьДжерело записано
Видавець
it.chosun.com
Посилання на джерело
it.chosun.comhttps://it.chosun.com/news/articleView.html?idxno=2023092170991
Тип джерела
Репортаж інформаційного видання — не документ першої сторони.

Чого ми не змогли підтвердити незалежно: Ця претензія пов’язана з названою торговою точкою. Ми не перевіряли це за документом першої сторони. (it.chosun.com)

КонтекстЗрозумійте це за 60 секунд

Почніть тут

Ключові терміни

ШІ Безпека
Область, зосереджена на зниженні шкідливої ​​поведінки, збоїв і ризиків неправильного використання в системах ШІ.
Еталон
Стандартизований тест або набір даних, який використовується для вимірювання та порівняння продуктивності моделі.
Перевір себеВікторина з етики ШІ

Що сталося

Kakao announced that it has signed a memorandum of understanding (MOU) with the Institute on September 28, 2026, to jointly evaluate the safety of its AI models and agents. Under the agreement, Kakao will provide its AI models—including the in‑house language model ‘Kanana‑1.5‑9.8B’—and AI agents for assessment, as well as the infrastructure needed for testing. The AI Safety Institute will conduct the evaluations and work on advancing the assessment methodology. The partnership defines a three‑stage safety verification roadmap: Stage 1 focuses on pre‑ and post‑deployment safety of language models; Stage 2 expands the scope to multimodal language models and AI agents; and Stage 3 aims to co‑create proprietary evaluation tools that can independently verify model and agent safety. The MOU builds on a prior joint safety assessment of Kakao’s Kanana model, which the institute reported performed comparably to overseas models of similar scale.

On September 28, 2026, Kakao and the Institute signed an MOU to jointly evaluate the safety of Kakao’s AI models and agents, according to a report by IT조선. The agreement outlines responsibilities for each party: Kakao will supply the AI models and agents slated for assessment and provide the necessary infrastructure, while the institute will carry out the safety evaluations and refine the assessment methodology.

The partnership builds on a prior joint safety assessment of Kakao’s proprietary language model, Kanana‑1.5‑9.8B, which the institute said performed at a high safety level compared with similarly sized overseas models. The new MOU expands the scope to include multimodal language models and AI agents, and sets a three‑stage verification plan that culminates in the co‑development of an independent safety assessment tool.

The three‑stage plan is structured as follows: Stage 1 evaluates pre‑deployment and post‑deployment safety of language models; Stage 2 adds multimodal language models and AI agents to the evaluation pool; Stage 3 focuses on creating a joint assessment tool that can independently verify safety for both models and agents. Both parties intend to review the assessment outcomes together and later decide on the extent of public disclosure.

Деталі джерела: it.chosun.com ↗

Чому це важливо

The collaboration signals a growing emphasis on systematic safety testing for AI systems beyond text‑only models, extending to multimodal and agent‑based applications. By involving an external research institute, Kakao seeks to add independent credibility to its safety claims, which could influence user trust and regulatory scrutiny in South Korea’s rapidly expanding AI market. The three‑stage framework may serve as a template for other Korean firms seeking to formalize safety evaluations, potentially shaping industry standards and informing future policy discussions on AI risk mitigation. Moreover, the joint development of assessment tools could lower barriers for smaller developers to conduct rigorous safety checks, fostering broader adoption of best‑practice safety protocols.

The initiative reflects a broader industry shift toward rigorous safety testing for AI systems that go beyond text generation, addressing emerging risks associated with multimodal inputs and autonomous agents. By partnering with an external institute, Kakao aims to add an independent layer of validation, which can bolster user confidence and pre‑empt regulatory concerns.

The three‑stage framework could become a de‑facto for Korean AI developers, encouraging the adoption of systematic safety protocols across the sector. This may influence future policy formulation, as regulators often look to industry‑led standards when drafting guidelines.

Co‑developing assessment tools may democratize safety testing, allowing smaller firms without extensive resources to evaluate their models against consistent criteria. This could lead to higher overall safety standards in the Korean AI ecosystem.

Interactive Mechanism

Інтерактивний механізм: як він насправді працює

Дослідіть технологію, що лежить в основі цієї розробки, в інтерактивному режимі.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Інтерактивна перевірка концепції+10 Points
AI Ethics Quiz

Impossibility results in algorithmic fairness (e.g. Kleinberg et al., Chouldechova) show what?

Що дивитися далі

Future updates from the partnership will reveal the specific metrics and benchmarks used in each verification stage, as well as the timeline for releasing the co‑developed evaluation tools. Observers should monitor whether the assessment results are publicly disclosed and how they compare to international safety standards. Additionally, the impact of this collaboration on Kakao’s product roadmap—such as the deployment of AI agents in its messaging and search services—will indicate how safety considerations are integrated into commercial rollouts. Regulatory bodies may also reference this MOU when drafting guidelines for testing in Korea.

The timeline for releasing the jointly developed safety assessment tool and the specific evaluation metrics will be critical to gauge the partnership’s practical impact.

Whether the assessment results will be made public, and how they compare with international safety benchmarks, will indicate the transparency and rigor of the process.

Regulatory responses in South Korea, such as potential incorporation of the three‑stage framework into official guidelines, will be a key indicator of the partnership’s influence on policy.

The rollout of AI agents in Kakao’s consumer services, and how safety findings shape their deployment, will provide concrete evidence of the collaboration’s effect on product development.

Пов’язані посібники та вікторини

Етика ШІПояснення моделей AIАгенти ШІПеревірте свої знання — пройдіть безкоштовну вікторину зі штучним інтелектомЗнайдіть термін ШІ в нашому глосаріїСлідкуйте за трекером фінансування ШІ
Знайшли це корисним?