Back to News
ProductAI Understanding briefing

Supermicro unveils NVIDIA Vera CPU rack, a 256‑CPU liquid‑cooled solution for agentic AI

Supermicro announced the NVIDIA Vera CPU rack, a 256‑CPU, 100% liquid‑cooled rack‑scale system designed to host up to 22,500 concurrent agent sandboxes for large‑scale agentic AI and reinforcement‑learning workloads.

4 min readRead the linked source
Source-provided image accompanying Supermicro unveils NVIDIA Vera CPU rack, a 256‑CPU liquid‑cooled solution for agentic AI
Source referenceSource recorded
Publisher
prnewswire.com
Source type
Linked source — primary-source status has not been established.
ContextUnderstand this in 60 seconds

Key terms

Reinforcement Learning
Training by reward signals where an agent learns actions that maximize long-term return.
Inference
The runtime phase where a trained model generates predictions or outputs.
AI Agent
A software system that can observe, reason, and take actions to achieve a goal, often using tools and memory.
Test yourselfAI Agents Quiz

What happened

Supermicro introduced the NVIDIA Vera CPU rack as the latest addition to its Data Center Building Block Solutions (DCBBS) portfolio. The rack integrates 256 NVIDIA Vera CPUs, delivering 22,528 cores and 45,056 threads, and supports up to 22,500 concurrent agent sandboxes. It uses a 100% liquid‑cooled DLC‑2 cooling stack, NVIDIA BlueField‑4 DPUs for networking and security, and can be powered by either traditional AC or an 800 VDC sidecar with battery backup units. The system can be deployed standalone or alongside Supermicro’s NVIDIA Vera Rubin NVL72 GPU racks, forming a common architecture for “AI factories.” The product is available for quote now, but pricing and detailed availability terms were not disclosed.

Supermicro’s press release describes the NVIDIA Vera CPU rack as a 256‑CPU, 100% liquid‑cooled solution built on the third‑generation NVIDIA MGX reference architecture. The rack’s DLC‑2 cooling stack circulates liquid directly to each CPU, eliminating the need for traditional air‑cooled fans and enabling higher compute density.

Each Vera CPU contributes 88 cores, resulting in a total of 22,528 cores and 45,056 threads per rack. The integrated BlueField‑4 DPUs provide high‑throughput networking and in‑silicon security functions, while the OpenShell reference architecture enforces least‑privilege policies for agent workloads at runtime.

The system can be powered by a conventional AC feed or an 800 VDC sidecar that supports battery backup units (BBU) instead of a traditional UPS, a design intended to free floor space and improve power conversion efficiency. Supermicro offers design, integration, and on‑site support services for both standalone and paired deployments with the Vera Rubin NVL72 GPU rack.

Supermicro states the rack is available for quote now, but the release does not include specific pricing, lead times, or geographic availability beyond the United States.

Source details: prnewswire.com ↗

Why it matters

The Vera CPU rack addresses a growing bottleneck in large‑scale agentic AI deployments: the need for dense, high‑performance CPU resources to run thousands of parallel sandbox environments that orchestrate tool use, evaluate results, and manage workflow logic. While GPUs excel at token generation, CPUs are essential for the branching, looped execution patterns of reinforcement‑learning and autonomous‑agent workloads. By delivering a purpose‑built, liquid‑cooled, high‑density CPU platform, Supermicro aims to reduce floor‑space, power, and cooling costs while providing hardware‑based security via BlueField‑4 DPUs and NVIDIA OpenShell policy enforcement. This could accelerate the rollout of AI factories that require both massive GPU capacity and robust CPU orchestration, potentially lowering total cost of ownership for enterprises scaling agentic AI.

Agentic AI workloads, such as large‑scale and autonomous‑agent orchestration, require massive parallel CPU capacity to manage sandboxed environments, tool execution, and decision loops. Existing data‑center designs often rely on air‑cooled CPUs that cannot scale to the densities needed for thousands of concurrent agents.

By delivering a liquid‑cooled, high‑density CPU platform, Supermicro aims to reduce the physical footprint and power consumption per compute unit, addressing both CapEx and OpEx concerns for enterprises building AI factories.

The inclusion of BlueField‑4 DPUs and OpenShell security layers provides hardware‑rooted isolation and policy enforcement, which is increasingly important as regulatory scrutiny of behavior grows.

If the claimed capacity and performance hold up in real‑world deployments, the Vera CPU rack could become a reference architecture for next‑generation AI data centers, influencing future hardware roadmaps from both OEMs and cloud providers.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
AI Agents Quiz

An agent must create a draft calendar event for Tuesday at 2 p.m. Which evidence would establish the requested result?

What to watch next

Key indicators to monitor include: (1) early customer deployments and performance benchmarks that validate the claimed 22,500 concurrent sandboxes; (2) pricing structures and financing options once quotes are issued, which will affect adoption rates; (3) integration feedback on the OpenShell and Sentry security stack, especially in regulated industries; and (4) supply‑chain stability for the NVIDIA Vera CPUs and BlueField‑4 DPUs, given global semiconductor constraints.

Early adopters’ performance data: Benchmarks that demonstrate the ability to sustain 22,500 concurrent sandboxes will be critical to validate the rack’s value proposition.

Pricing and financing: Without disclosed pricing, the economic case for the rack remains speculative. Market response will hinge on competitive cost per core and total cost of ownership versus traditional air‑cooled solutions.

Security stack adoption: The effectiveness of OpenShell and NVIDIA Sentry in real deployments will be watched by regulated sectors (finance, healthcare) that need auditable behavior.

Supply chain health: The availability of NVIDIA Vera CPUs and BlueField‑4 DPUs will affect rollout speed, especially given ongoing semiconductor shortages.

Related guides & quizzes

Found this useful?