返回新闻
工业AI Understanding 简报

TechCrunch:Nvidia 的 AI 优势正在扩展到 GPU 之外

TechCrunch 报道称,Nvidia 通过 CPU、网络、存储和编排系统日益激烈地竞争,这些系统可帮助大型 AI 数据中心围绕 GPU 高效地移动数据。

5 min readRead the original reporting
Source-provided image accompanying TechCrunch: Nvidia’s AI advantage is expanding beyond GPUs
归因报告来源记录
出版商
techcrunch.com
来源链接
techcrunch.comhttps://techcrunch.com/2026/08/29/nvidias-ai-advantage-is-moving-beyond-the-gpu/
来源类型
新闻媒体的报道——不是第一方文件。

我们无法独立确认的内容: 此声明归因于指定的商店。我们没有根据第一方文件对其进行验证。 (techcrunch.com)

背景60 秒内了解这一点

从这里开始

关键术语

内存(代理内存)
AI 代理跨步骤或会话使用存储的上下文来提高连续性。
基准测试
用于测量和比较模型性能的标准化测试或数据集。
推理
经过训练的模型生成预测或输出的运行时阶段。
测试一下自己AI 模型解释测验

发生了什么

TechCrunch reports that Nvidia’s competitive advantage in AI infrastructure is shifting beyond its graphics processors. As AI data centers scale toward gigawatt-level power consumption, the company is selling integrated systems intended to coordinate memory, storage, networking and compute around the GPU. The report focuses on Nvidia’s Vera Rubin architecture, which combines the Rubin GPU with the Vera CPU, Groq 3 LPX accelerators and related storage and networking racks. Nvidia executive Jason Hardy told TechCrunch that the Vera CPU is designed to help direct data to the GPU at the right time. Hardy said Nvidia saw up to a threefold improvement in certain operations, though TechCrunch did not independently verify that claim. TechCrunch also compares Nvidia’s approach with OpenAI’s Jalapeño chip, which was designed to reduce data movement by keeping an entire workload within one connected system. The approaches differ, but both address the same infrastructure problem: moving data efficiently can matter as much as adding processor capacity.

TechCrunch reports that Nvidia’s recent AI advantage is increasingly tied to infrastructure surrounding the GPU. The outlet says AI computing is growing toward gigawatt scale, making it more difficult to operate large data centers efficiently. In that environment, the article argues, coordinating data movement and system components becomes a central engineering challenge rather than a secondary concern.

The report identifies Nvidia’s Vera Rubin architecture as an example of this strategy. According to TechCrunch, the architecture pairs the Rubin GPU with the Vera CPU, Groq 3 LPX accelerators and comparable racks for storage and networking. The outlet describes these components as specialized systems intended to improve the operation of everything around the GPU, rather than simply processing tokens themselves.

Jason Hardy, Nvidia’s vice president of storage technology, told TechCrunch that the Vera CPU addresses the limited memory capacity of a single server or compute platform and helps orchestrate data. TechCrunch reports Hardy as saying Nvidia observed up to a threefold improvement in certain operations and could use flash storage more fully without creating a bottleneck. That performance claim comes from Nvidia and was not independently confirmed in the source.

TechCrunch contrasts Nvidia’s system-level approach with OpenAI’s Jalapeño chip. The outlet quotes OpenAI as saying Jalapeño was designed to minimize data movement and communication delays by keeping an entire workload within one connected system. Nvidia and OpenAI are using different designs, but TechCrunch says both seek efficiency through smarter control of data movement rather than only through additional processor cycles.

来源详情: techcrunch.com ↗

为什么这很重要

The report describes a shift in how AI infrastructure may be evaluated. GPU performance remains important, but the practical output of a large AI system can also depend on memory access, storage, networking and the software and hardware used to coordinate those components. That could make it harder for competitors to challenge Nvidia simply by offering an alternative accelerator. A rival would need to match the performance of a broader system, including the connections among chips and the mechanisms that keep expensive processors supplied with data. The implications remain uncertain. TechCrunch’s account is based partly on Nvidia’s own explanation of its systems and an executive’s performance claim. The source does not provide independent results, pricing, deployment figures or evidence that Nvidia’s full-system advantage will persist as hyperscalers develop their own infrastructure.

The report matters because it broadens the definition of AI computing capacity. A powerful accelerator can be underused if data, model parameters or intermediate results do not reach it quickly enough. The article’s central point is that system design can determine how effectively expensive AI processors are used.

This creates a possible barrier to challengers. TechCrunch reports that hyperscalers such as Amazon and Google have developed their own chips, reducing Nvidia’s status as the only provider of advanced AI GPUs. But an alternative GPU or accelerator may not be sufficient if it lacks comparable memory, storage, networking and orchestration capabilities.

The shift could also affect infrastructure spending. If data movement and coordination are major constraints, buyers may need to evaluate complete racks and system architectures rather than compare accelerator specifications alone. That could strengthen the position of suppliers that can provide tightly integrated hardware and software, while potentially increasing the complexity and cost of switching vendors.

The evidence has important limits. TechCrunch’s reporting includes conversations with Nvidia personnel and a performance figure supplied by a Nvidia executive, but the source provides no independent testing, customer deployment data, prices, power measurements or comparison with competing systems. The report supports the existence of Nvidia’s broader system strategy, but it does not prove that the company will maintain a durable lead.

Interactive Mechanism

互动机制:它实际上是如何运作的

以交互方式探索这一发展背后的基础技术。

Document Size:128K tokens
Needle Placement Depth (Location in document):50% into text
Attention Context Buffer Map:
Target Fact (50%)
Equivalent Pages~320Standard book pages
Retrieval Accuracy99.9%Needle recall score
RAM / KV Cache5.1 GBMemory overhead
Prompt CachingActive~80% discount on reuse
Core takeaway: Million-token context windows allow querying whole codebases or legal archives in one prompt. However, KV cache memory scales with context length, making prompt caching crucial for real-time production.
交互式概念检查+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

接下来看什么

Watch whether Nvidia publishes independent, reproducible measurements for the Vera Rubin system, including end-to-end throughput, energy use, memory and storage performance, and the conditions behind the reported threefold improvement. Watch how Amazon, Google and other large cloud operators respond. TechCrunch reports that hyperscalers have been developing their own chips, but the more consequential competition may involve complete systems for coordinating compute, memory, storage and networking. Also watch whether customers buy Nvidia’s integrated infrastructure as a package or substitute components from multiple vendors. The report suggests that orchestration is becoming a major competitive layer, but it does not establish how widely Nvidia’s systems are available, what they cost, or how they perform in production.

The most useful next evidence would be transparent, third-party testing of Vera Rubin systems. Such testing should separate GPU performance from gains attributable to the Vera CPU, flash storage, networking and orchestration, and should explain the workloads and baseline used for any claimed improvement.

Availability and purchasing terms will also matter. The source describes Nvidia’s architecture and current rollout but does not say which customers can obtain the systems, in what quantities, at what price, or whether individual components can be mixed with hardware from other suppliers. Those details will determine whether the strategy is broadly practical or mainly an integrated Nvidia offering.

Competitors’ responses will show whether the market is moving toward system-level competition. Cloud providers may design alternative architectures around their own chips, while other chipmakers may focus on memory, networking, storage or interconnects rather than compete directly on GPU performance. The source does not identify specific rival systems or provide evidence about their current capabilities.

OpenAI’s Jalapeño design is a useful comparison, but it should not be treated as proof that one approach is superior. OpenAI’s statement, quoted by TechCrunch, describes an effort to reduce data movement inside a connected chip. More information is needed to compare that design with Nvidia’s distributed orchestration model across real workloads, energy use, reliability and total operating cost.

相关指南和测验

人工智能模型解释变形金刚人工智能培训AI 的未来测试你所知道的——尝试免费的人工智能测验在我们的词汇表中查找人工智能术语关注 AI 资金追踪器
觉得这有用吗?