Back to News
ProductAI Understanding briefing

AMD details open Helion rack design for agentic AI workloads

DataCenterNews Asia Pacific reports that AMD is contributing its Helion agentic AI rack specification to the Open Compute Project, with CPU-only and mixed CPU-GPU configurations for different workloads.

4 min readRead the linked source
Source-provided image accompanying AMD details open Helion rack design for agentic AI workloads
Source referenceSource recorded
Publisher
datacenternews.asia
Source type
Linked source — primary-source status has not been established.
ContextUnderstand this in 60 seconds

Key terms

Inference
The runtime phase where a trained model generates predictions or outputs.
Compute
The processing resources required to train and run models, often measured in FLOPS or GPU hours.
Latency
The time between sending a request and receiving the model's output.
Test yourselfAI Agents Quiz

What happened

DataCenterNews Asia Pacific reports that AMD introduced Helion, an open rack-scale infrastructure design for agentic AI workloads. The design supports CPU-only systems and mixed systems using AMD EPYC processors and Instinct MI350P GPUs, with liquid- or air-cooled configurations and open software support.

According to DataCenterNews Asia Pacific, one Helion configuration uses sixth-generation AMD EPYC processors and supports up to 32,768 CPU cores. AMD is positioning that version for hyperscale customers needing dedicated capacity for agent execution while connecting to separate systems for model .

A second configuration combines EPYC CPU nodes, Instinct MI350P GPU nodes and general-purpose in one rack for enterprise users. The report also says Helion includes an integrated token router intended to direct model calls across frontier and open-source models according to operational requirements such as task or cost.

AMD plans to contribute the specification to the Open Project. Cisco, Dell, Hon Hai Technology Group, HPE, Lenovo, QCT, Supermicro and Wiwynn provided support statements, according to the report. The named companies’ participation does not by itself establish commercial availability or deployment at scale.

The report identifies hardware partners, enterprise customers and hyperscalers as the intended users, but it does not document a purchase channel, price, Helion shipment date or general availability. It also does not independently verify AMD’s claims about the design or related Helios deployments.

Source details: datacenternews.asia ↗

Why it matters

The design reflects a shift from selling individual chips toward complete AI infrastructure that combines , cooling, networking, system integration and model routing. It could give enterprises and hyperscalers more flexibility in matching infrastructure to agent workloads, although the report does not independently verify performance, deployment readiness or customer availability.

Agentic systems can combine model with code execution, workflow management and other -intensive tasks. A rack designed for multiple mixes of CPUs and GPUs may therefore be more adaptable than infrastructure optimized for a single model-serving pattern. The practical implication is that buyers could size systems around the actual balance between agent execution, inference and general-purpose workloads.

The proposed open specification could also make it easier for server manufacturers and integrators to build compatible systems, potentially reducing dependence on a single vertically integrated infrastructure stack. However, openness of a reference design does not guarantee interoperability, lower costs or equivalent performance across implementations.

DataCenterNews Asia Pacific frames Helion as part of AMD’s effort to compete at the full-system level. That strategic significance is clear from the report, but independent benchmarks, customer results, power measurements and deployment data are not provided.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
AI Agents Quiz

An agent must create a draft calendar event for Tuesday at 2 p.m. Which evidence would establish the requested result?

What to watch next

The important next steps are AMD’s proposed Open Project contribution, partner implementations, and evidence from real deployments showing whether the design delivers useful cost, power and workload flexibility.

Watch whether the Open Project accepts and publishes the Helion specification, and which parts of the design become available to partners. The report describes a planned contribution, not a completed standard.

Further reporting should establish whether Helion systems can be ordered, when they will ship, which configurations partners will offer, and how pricing varies between CPU-only and CPU-GPU racks.

The token router is a notable operational component, but its supported models, governance controls, , security features and compatibility with customers’ existing orchestration systems remain unknown.

AMD’s claims about Helios entering production and systems running at OpenAI, Meta, Microsoft and Oracle are reported company statements; the report does not provide independent confirmation or deployment results.

Related guides & quizzes

Found this useful?