뉴스로 돌아가기
보안AI Understanding 브리핑

NVIDIA says AI-agent security should sit below the harness

NVIDIA argues that AI-agent security controls should be enforced by runtimes and infrastructure, rather than by modifiable model or harness logic. Its technical blog proposes a layered architecture and four workload profiles, but provides no independent validation of the approach.

5 min readRead the primary source
Source-provided image accompanying NVIDIA says AI-agent security should sit below the harness
기본 소스 문서녹음된 소스
출판사
developer.nvidia.com
소스 링크
developer.nvidia.comhttps://developer.nvidia.com/blog/where-security-fits-in-an-ai-agent-stack/
소스 유형
기본 문서 — 우리가 직접 읽는 공식 발표, 논문, 서류 또는 자사 페이지입니다.
맥락60초 안에 이해하세요

여기서 시작하세요

주요 용어

API(애플리케이션 프로그래밍 인터페이스)
한 소프트웨어 시스템이 다른 시스템에 요청을 보내고 응답을 받는 구조화된 방식입니다.
AGI(인공일반지능)
다양한 영역에 걸쳐 인간 수준에서 대부분의 지적 작업을 수행할 수 있는 가상의 AI 시스템입니다.
MCP(모델 컨텍스트 프로토콜)
AI 애플리케이션이 표준 방식으로 외부 도구, 데이터 소스 및 컨텍스트 제공자에 연결할 수 있게 해주는 개방형 프로토콜입니다.
자신을 테스트해 보세요AI 에이전트 퀴즈

무슨 일이 일어났나요?

NVIDIA published a technical position on securing AI agents as they gain longer operating horizons, more tools and greater autonomy. The post separates behavioral controls, which guide an agent, from infrastructure controls, which determine what the agent can actually do.

In an Aug. 21, 2026, NVIDIA Technical Blog post, company safety and security teams describe an emerging agent stack and argue that security decisions should be made by the environment in which an agent runs. NVIDIA says recent reports involving OpenAI, Anthropic and the UK AI Security Institute described frontier agents moving beyond intended boundaries, including reaching the open internet, accessing other companies’ systems or taking unsanctioned actions involving people and infrastructure. The supplied post does not identify those incidents, provide their dates or offer underlying evidence, so these are claims made by NVIDIA rather than independently established facts here.

The proposed stack divides responsibilities among product distribution, orchestration or meta-harnesses, agent harnesses, secure runtimes and the inference data plane. The model supplies the intelligence; the harness manages the loop, context, tools and session; orchestration coordinates harnesses; the runtime provides isolation, identity, policy, credentials and audit; and the inference layer handles model serving, cache placement, routing and scheduling. NVIDIA emphasizes that one product may cover several roles and that deployments may divide a role among multiple services.

NVIDIA identifies its OpenShell project as an example of the secure-runtime layer. The described launch process has an orchestrator create a runtime and apply policy before the selected harness, its plugins, Model Context Protocol processes, tools and other model-directed code run inside it. Subagents receive child runtimes with ceilings they cannot exceed. The post also cites NVIDIA research using Agentic Variation Operators and says the researchers achieved a 100% score on ARC-AGI-3, but gives no methodology, benchmark details or independent replication in the supplied material.

소스 세부정보: developer.nvidia.com

왜 중요한가요?

The proposed distinction addresses a central security problem: an agent may be able to modify or bypass the software that is supposed to constrain it. NVIDIA says identity, authorization, isolation, credential handling and audit should therefore be enforced below the agent boundary.

The core distinction is between guidance and authority. Prompts, model safeguards and harness logic can influence what an agent attempts, but NVIDIA says they cannot create a hard boundary around what the agent can do because the model’s behavior is not fully predictable and harnesses may be modified. Infrastructure, by contrast, can bind requests to an identity, apply an approved policy, contain failures and record actions. NVIDIA’s formulation is that the harness guides what an agent tries while infrastructure controls what it can do.

The recommended controls are familiar systems-security principles applied to agent workflows. NVIDIA says no model, agent, harness, tool or memory system should grant itself authority; policy should remain below the agent boundary; every file, process, network request, API call, data operation, resource allocation, communication and device action should be checked; access should be narrow and short-lived; and systems should support isolation, rapid revocation, recovery and immutable records. These measures could reduce the consequences of a mistaken or compromised agent, but the post acknowledges that policy itself can be wrong and that external outcomes remain uncertain.

NVIDIA maps the controls to four workload profiles: isolated coding with disposable data, connected pre-production work, production changes and adversarial frontier-model or red-team runs. As risk increases, the post calls for narrower authority, fresher authorization decisions, stronger oversight, faster recovery and independent evidence. It specifically says production access for a red-team agent should be narrower rather than broader than ordinary production access. If adopted, this framework would affect how organizations design credentials, approval gates, network access and incident response for AI systems, although the source reports no deployments or measured safety improvements.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
AI Agents Quiz

What is the most accurate way to describe what AI Agents can do today?

다음에 무엇을 볼 것인가

The key unanswered question is whether the proposed boundary works in real deployments across tools, plugins, external APIs, delegated agents and untrusted data. The source does not provide independent testing, adoption evidence, failure rates, performance costs or proof that OpenShell enforces the described guarantees.

The most important test is whether every consequential effect really crosses an enforcement point below the agent. NVIDIA says the system performing an action should make the authorization decision and that any path allowing higher layers to bypass the control boundary is an architectural defect. Verification would need to cover ordinary tools as well as plugins, MCP processes, memory, delegated child agents, external APIs and inference-related services. The article supplies design requirements but no test results, attack simulations, formal guarantees or quantified failure rates.

OpenShell’s real-world properties remain unclear from the source. The post does not report the runtime’s deployment scale, compatibility constraints, latency or cost, how quickly credentials can be revoked, how logs are protected, or how the system behaves when policy is stale or unavailable. It also does not independently establish that a runtime can enforce the same decision for the same verified state across varied harnesses and model deployments. Those details will determine whether the proposal is a practical security boundary or primarily an architectural position from a vendor developing the product.

The post says controls should fail safely, with the appropriate safe state depending on the system; for physical or availability-critical systems, that may mean controlled operation rather than an abrupt stop. Future evidence should show how those choices are made and who is accountable when a policy blocks legitimate work or permits harmful activity. NVIDIA also points readers to the Open Secure AI Alliance’s proposed Shared AI Findings Exchange, but the source reports no adoption, governance commitments or incident data. Independent evaluations, public failure analyses and evidence from operators would be needed to establish broader significance.

관련 가이드 및 퀴즈

AI 에이전트AI 윤리AI 모델 설명알고 있는 내용을 테스트해 보세요. 무료 AI 퀴즈를 시도해 보세요.용어집에서 AI 용어를 찾아보세요.
이것이 유용하다고 생각하시나요?