뉴스로 돌아가기
산업AI Understanding 브리핑

카카오, AI안전연구소와 손잡고 3단계 AI 모델 및 에이전트 안전성 검증 출시

카카오는 AI안전연구소와 언어모델과 AI 에이전트의 안전성을 공동 평가하기 위한 MOU를 체결하고 3단계 평가 프로세스를 개략적으로 설명하고 평가 도구를 공동 개발할 계획이다.

4 min readRead the original reporting
Source-provided image accompanying Kakao partners with AI Safety Institute to launch three‑stage AI model and agent safety verification
기여 보고녹음된 소스
출판사
it.chosun.com
소스 링크
it.chosun.comhttps://it.chosun.com/news/articleView.html?idxno=2023092170991
소스 유형
자사 문서가 아닌 뉴스 매체를 통한 보도입니다.

자체적으로는 확인할 수 없었던 내용: 이 소유권 주장은 해당 매장에 귀속됩니다. 당사는 자사 문서와 비교하여 이를 확인하지 않았습니다. (it.chosun.com)

맥락60초 안에 이해하세요

여기서 시작하세요

주요 용어

AI 안전
AI 시스템의 유해한 행동, 실패, 오용 위험을 줄이는 데 중점을 둔 분야입니다.
벤치마크
모델 성능을 측정하고 비교하는 데 사용되는 표준화된 테스트 또는 데이터 세트입니다.
자신을 테스트해 보세요AI 윤리 퀴즈

무슨 일이 일어났나요?

Kakao announced that it has signed a memorandum of understanding (MOU) with the Institute on September 28, 2026, to jointly evaluate the safety of its AI models and agents. Under the agreement, Kakao will provide its AI models—including the in‑house language model ‘Kanana‑1.5‑9.8B’—and AI agents for assessment, as well as the infrastructure needed for testing. The AI Safety Institute will conduct the evaluations and work on advancing the assessment methodology. The partnership defines a three‑stage safety verification roadmap: Stage 1 focuses on pre‑ and post‑deployment safety of language models; Stage 2 expands the scope to multimodal language models and AI agents; and Stage 3 aims to co‑create proprietary evaluation tools that can independently verify model and agent safety. The MOU builds on a prior joint safety assessment of Kakao’s Kanana model, which the institute reported performed comparably to overseas models of similar scale.

On September 28, 2026, Kakao and the Institute signed an MOU to jointly evaluate the safety of Kakao’s AI models and agents, according to a report by IT조선. The agreement outlines responsibilities for each party: Kakao will supply the AI models and agents slated for assessment and provide the necessary infrastructure, while the institute will carry out the safety evaluations and refine the assessment methodology.

The partnership builds on a prior joint safety assessment of Kakao’s proprietary language model, Kanana‑1.5‑9.8B, which the institute said performed at a high safety level compared with similarly sized overseas models. The new MOU expands the scope to include multimodal language models and AI agents, and sets a three‑stage verification plan that culminates in the co‑development of an independent safety assessment tool.

The three‑stage plan is structured as follows: Stage 1 evaluates pre‑deployment and post‑deployment safety of language models; Stage 2 adds multimodal language models and AI agents to the evaluation pool; Stage 3 focuses on creating a joint assessment tool that can independently verify safety for both models and agents. Both parties intend to review the assessment outcomes together and later decide on the extent of public disclosure.

소스 세부정보: it.chosun.com ↗

왜 중요한가요?

The collaboration signals a growing emphasis on systematic safety testing for AI systems beyond text‑only models, extending to multimodal and agent‑based applications. By involving an external research institute, Kakao seeks to add independent credibility to its safety claims, which could influence user trust and regulatory scrutiny in South Korea’s rapidly expanding AI market. The three‑stage framework may serve as a template for other Korean firms seeking to formalize safety evaluations, potentially shaping industry standards and informing future policy discussions on AI risk mitigation. Moreover, the joint development of assessment tools could lower barriers for smaller developers to conduct rigorous safety checks, fostering broader adoption of best‑practice safety protocols.

The initiative reflects a broader industry shift toward rigorous safety testing for AI systems that go beyond text generation, addressing emerging risks associated with multimodal inputs and autonomous agents. By partnering with an external institute, Kakao aims to add an independent layer of validation, which can bolster user confidence and pre‑empt regulatory concerns.

The three‑stage framework could become a de‑facto for Korean AI developers, encouraging the adoption of systematic safety protocols across the sector. This may influence future policy formulation, as regulators often look to industry‑led standards when drafting guidelines.

Co‑developing assessment tools may democratize safety testing, allowing smaller firms without extensive resources to evaluate their models against consistent criteria. This could lead to higher overall safety standards in the Korean AI ecosystem.

Interactive Mechanism

대화형 메커니즘: 실제로 작동하는 방식

이 개발의 이면에 있는 기본 기술을 대화식으로 살펴보세요.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
대화형 개념 확인+10 Points
AI Ethics Quiz

Impossibility results in algorithmic fairness (e.g. Kleinberg et al., Chouldechova) show what?

다음에 무엇을 볼 것인가

Future updates from the partnership will reveal the specific metrics and benchmarks used in each verification stage, as well as the timeline for releasing the co‑developed evaluation tools. Observers should monitor whether the assessment results are publicly disclosed and how they compare to international safety standards. Additionally, the impact of this collaboration on Kakao’s product roadmap—such as the deployment of AI agents in its messaging and search services—will indicate how safety considerations are integrated into commercial rollouts. Regulatory bodies may also reference this MOU when drafting guidelines for testing in Korea.

The timeline for releasing the jointly developed safety assessment tool and the specific evaluation metrics will be critical to gauge the partnership’s practical impact.

Whether the assessment results will be made public, and how they compare with international safety benchmarks, will indicate the transparency and rigor of the process.

Regulatory responses in South Korea, such as potential incorporation of the three‑stage framework into official guidelines, will be a key indicator of the partnership’s influence on policy.

The rollout of AI agents in Kakao’s consumer services, and how safety findings shape their deployment, will provide concrete evidence of the collaboration’s effect on product development.

관련 가이드 및 퀴즈

AI 윤리AI 모델 설명AI 에이전트알고 있는 내용을 테스트해 보세요. 무료 AI 퀴즈를 시도해 보세요.용어집에서 AI 용어를 찾아보세요.AI 자금 추적기를 팔로우하세요
이것이 유용하다고 생각하시나요?