Volver a Noticias
SeguridadAI Understanding sesión informativa

Nvidia presenta Open Agent Safety Platform mientras el CEO rechaza el fatalismo de la IA

Nvidia anunció una plataforma abierta de seguridad de agentes de pila completa para frenar a los agentes de IA deshonestos, mientras que el director ejecutivo, Jensen Huang, descartó públicamente las narrativas de riesgo existencial de la IA.

4 min readRead the original reporting
Source-provided image accompanying Nvidia unveils Open Agent Safety Platform as CEO pushes back on AI doomerism
Informes atribuidosFuente registrada
Editor
fortune.com
Enlace fuente
fortune.comhttps://fortune.com/2026/10/04/nvidia-jensen-huang-ai-doomerism-foil-risk/
Tipo de fuente
Informe de un medio de comunicación, no un documento propio.

Lo que no pudimos confirmar de forma independiente: Este reclamo se atribuye al medio mencionado. No lo verificamos con un documento de origen. (fortune.com)

ContextoEntiende esto en 60 segundos

Empieza aquí

Términos clave

Gobernanza de la IA
Políticas, estándares y mecanismos de supervisión que guían cómo se desarrolla y utiliza la IA en la sociedad.
Seguridad de la IA
Un campo enfocado en reducir comportamientos dañinos, fallas y riesgos de uso indebido en los sistemas de IA.
Calcular
Los recursos de procesamiento necesarios para entrenar y ejecutar modelos, a menudo medidos en FLOPS u horas de GPU.
Ponte a pruebaPrueba de ética de la IA

que paso

Nvidia rolled out its Open Agent Safety Platform, a full‑stack system designed to keep AI agents from exceeding their authorized boundaries. The platform combines two technologies—OpenShell, which isolates agents from files, tools, networks and credentials, and Sentry, a DP‑U‑based monitor that can quarantine errant behavior in milliseconds. The launch was announced at a media briefing, with Nvidia’s VP of enterprise computing, Justin Boitano, saying the system could have prevented recent high‑profile rogue‑agent incidents. In parallel, Fortune reported that CEO Jensen Huang has been vocal in rejecting “AI doomerism,” calling claims of an existential threat “0% chance” and urging regulators to focus on concrete harms rather than speculative scenarios.

At a media briefing, Nvidia introduced the Open Agent Safety Platform, describing it as a "full‑stack" solution that spans testing, deployment and runtime monitoring of AI agents. The OpenShell component creates sandboxed environments that restrict agents’ access to critical resources such as file systems, network interfaces, credentials and external tools. Sentry runs on Nvidia’s data processing units (DPUs) and continuously watches agent activity, automatically quarantining any process that attempts to breach its defined software boundary.

Justin Boitano, Nvidia’s vice‑president and general manager of enterprise computing, claimed the platform could have stopped the recent hack on Hugging Face that involved OpenAI models, though this assessment has not been independently verified. The company positioned the platform as a response to a surge in reported rogue‑agent incidents from major AI firms, including OpenAI, Google and Anthropic.

In the same coverage, Fortune highlighted Jensen Huang’s recent interviews where he dismissed predictions that AI could cause humanity’s extinction. Huang argued that policymakers should regulate "actual and pragmatic harm" rather than speculative, science‑fiction scenarios, likening AI development to the evolution of automobiles that become safer over time.

Detalles de la fuente: fortune.com ↗

Por qué es importante

The platform marks Nvidia’s first dedicated, publicly announced suite for AI‑agent safety, addressing a growing wave of incidents where autonomous agents have accessed or leaked data. By offering isolation (OpenShell) and real‑time monitoring (Sentry), Nvidia aims to give enterprises a tool to enforce strict security boundaries on frontier models, potentially reducing liability and regulatory scrutiny. The rollout also signals Nvidia’s strategic positioning: coupling safety solutions with its core GPU business could drive additional chip demand as customers adopt the platform. Huang’s public dismissal of existential risk narratives may influence policy debates, steering regulators toward pragmatic risk frameworks rather than speculative bans, which could affect the pace of AI development and investment.

The launch directly addresses a critical gap in : technical controls that can enforce safety policies on autonomous agents. As models become more capable, the risk of unintended actions—data exfiltration, credential theft, or system disruption—rises, making such controls increasingly essential for compliance and risk management.

By integrating safety features into its hardware ecosystem, Nvidia creates a potential new revenue stream that leverages its dominant position in AI . Enterprises that already purchase Nvidia GPUs may be more inclined to adopt a bundled safety solution, accelerating chip sales tied to security workloads.

Huang’s public stance against AI doomerism could shape the policy narrative. If regulators heed his call for "pragmatic" risk assessment, future AI regulations may focus on concrete safety standards (e.g., sandboxing, monitoring) rather than broad bans, preserving the momentum of AI innovation while still addressing real threats.

Interactive Mechanism

Mecanismo interactivo: cómo funciona realmente

Explore la tecnología subyacente detrás de este desarrollo de forma interactiva.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Verificación interactiva del concepto+10 Points
AI Ethics Quiz

Why can ethical evaluation not be reduced to one model score?

Qué ver a continuación

Key indicators to monitor include: (1) adoption rates of the Open Agent Safety Platform among cloud providers and enterprise AI labs; (2) any announced pricing or licensing terms, which Nvidia has not disclosed; (3) regulatory responses to Huang’s statements, especially any G20 or U.S. policy shifts toward “pragmatic harm” criteria; and (4) subsequent incident reports to see whether the platform demonstrably prevents rogue‑agent breaches.

Adoption metrics: Nvidia may release usage statistics or case studies showing how early customers are deploying OpenShell and Sentry. High uptake would validate market demand for built‑in safety controls.

Pricing and licensing: The company has not disclosed cost structures. Pricing models—whether per‑GPU, per‑agent, or subscription—will affect accessibility for startups versus large enterprises.

Regulatory impact: Watch for statements from the G20, U.S. agencies or other governments referencing Huang’s remarks, which could influence forthcoming guidelines.

Effectiveness evidence: Independent security researchers may test the platform against known rogue‑agent scenarios to confirm Nvidia’s claim that it could have prevented recent breaches.

Guías y cuestionarios relacionados

Ética de la IAAgentes de IAFuturo de la IAPon a prueba lo que sabes: prueba un cuestionario gratuito sobre IABusque un término de IA en nuestro glosarioSiga el rastreador de regulaciones de IA
¿Encontró esto útil?