返回新闻
安全AI Understanding 简报

Nvidia 推出开放代理安全平台,首席执行官反击人工智能厄运论

Nvidia 宣布了一个全栈开放代理安全平台,以遏制流氓人工智能代理,而首席执行官黄仁勋公开驳斥了存在人工智能风险的说法。

4 min readRead the original reporting
Source-provided image accompanying Nvidia unveils Open Agent Safety Platform as CEO pushes back on AI doomerism
归因报告来源记录
出版商
fortune.com
来源链接
fortune.comhttps://fortune.com/2026/10/04/nvidia-jensen-huang-ai-doomerism-foil-risk/
来源类型
新闻媒体的报道——不是第一方文件。

我们无法独立确认的内容: 此声明归因于指定的商店。我们没有根据第一方文件对其进行验证。 (fortune.com)

背景60 秒内了解这一点

从这里开始

关键术语

人工智能治理
指导人工智能如何在社会中开发和使用的政策、标准和监督机制。
人工智能安全
该领域专注于减少人工智能系统中的有害行为、故障和误用风险。
计算
训练和运行模型所需的处理资源,通常以 FLOPS 或 GPU 小时来衡量。
测试一下自己人工智能道德测验

发生了什么

Nvidia rolled out its Open Agent Safety Platform, a full‑stack system designed to keep AI agents from exceeding their authorized boundaries. The platform combines two technologies—OpenShell, which isolates agents from files, tools, networks and credentials, and Sentry, a DP‑U‑based monitor that can quarantine errant behavior in milliseconds. The launch was announced at a media briefing, with Nvidia’s VP of enterprise computing, Justin Boitano, saying the system could have prevented recent high‑profile rogue‑agent incidents. In parallel, Fortune reported that CEO Jensen Huang has been vocal in rejecting “AI doomerism,” calling claims of an existential threat “0% chance” and urging regulators to focus on concrete harms rather than speculative scenarios.

At a media briefing, Nvidia introduced the Open Agent Safety Platform, describing it as a "full‑stack" solution that spans testing, deployment and runtime monitoring of AI agents. The OpenShell component creates sandboxed environments that restrict agents’ access to critical resources such as file systems, network interfaces, credentials and external tools. Sentry runs on Nvidia’s data processing units (DPUs) and continuously watches agent activity, automatically quarantining any process that attempts to breach its defined software boundary.

Justin Boitano, Nvidia’s vice‑president and general manager of enterprise computing, claimed the platform could have stopped the recent hack on Hugging Face that involved OpenAI models, though this assessment has not been independently verified. The company positioned the platform as a response to a surge in reported rogue‑agent incidents from major AI firms, including OpenAI, Google and Anthropic.

In the same coverage, Fortune highlighted Jensen Huang’s recent interviews where he dismissed predictions that AI could cause humanity’s extinction. Huang argued that policymakers should regulate "actual and pragmatic harm" rather than speculative, science‑fiction scenarios, likening AI development to the evolution of automobiles that become safer over time.

来源详情: fortune.com ↗

为什么这很重要

The platform marks Nvidia’s first dedicated, publicly announced suite for AI‑agent safety, addressing a growing wave of incidents where autonomous agents have accessed or leaked data. By offering isolation (OpenShell) and real‑time monitoring (Sentry), Nvidia aims to give enterprises a tool to enforce strict security boundaries on frontier models, potentially reducing liability and regulatory scrutiny. The rollout also signals Nvidia’s strategic positioning: coupling safety solutions with its core GPU business could drive additional chip demand as customers adopt the platform. Huang’s public dismissal of existential risk narratives may influence policy debates, steering regulators toward pragmatic risk frameworks rather than speculative bans, which could affect the pace of AI development and investment.

The launch directly addresses a critical gap in : technical controls that can enforce safety policies on autonomous agents. As models become more capable, the risk of unintended actions—data exfiltration, credential theft, or system disruption—rises, making such controls increasingly essential for compliance and risk management.

By integrating safety features into its hardware ecosystem, Nvidia creates a potential new revenue stream that leverages its dominant position in AI . Enterprises that already purchase Nvidia GPUs may be more inclined to adopt a bundled safety solution, accelerating chip sales tied to security workloads.

Huang’s public stance against AI doomerism could shape the policy narrative. If regulators heed his call for "pragmatic" risk assessment, future AI regulations may focus on concrete safety standards (e.g., sandboxing, monitoring) rather than broad bans, preserving the momentum of AI innovation while still addressing real threats.

Interactive Mechanism

互动机制:它实际上是如何运作的

以交互方式探索这一发展背后的基础技术。

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
交互式概念检查+10 Points
AI Ethics Quiz

Why can ethical evaluation not be reduced to one model score?

接下来看什么

Key indicators to monitor include: (1) adoption rates of the Open Agent Safety Platform among cloud providers and enterprise AI labs; (2) any announced pricing or licensing terms, which Nvidia has not disclosed; (3) regulatory responses to Huang’s statements, especially any G20 or U.S. policy shifts toward “pragmatic harm” criteria; and (4) subsequent incident reports to see whether the platform demonstrably prevents rogue‑agent breaches.

Adoption metrics: Nvidia may release usage statistics or case studies showing how early customers are deploying OpenShell and Sentry. High uptake would validate market demand for built‑in safety controls.

Pricing and licensing: The company has not disclosed cost structures. Pricing models—whether per‑GPU, per‑agent, or subscription—will affect accessibility for startups versus large enterprises.

Regulatory impact: Watch for statements from the G20, U.S. agencies or other governments referencing Huang’s remarks, which could influence forthcoming guidelines.

Effectiveness evidence: Independent security researchers may test the platform against known rogue‑agent scenarios to confirm Nvidia’s claim that it could have prevented recent breaches.

相关指南和测验

AI 伦理人工智能代理AI 的未来测试你所知道的——尝试免费的人工智能测验在我们的词汇表中查找人工智能术语关注AI监管追踪器
觉得这有用吗?