Back to News
IndustryAI Understanding briefing

Epoch AI report finds AI costs falling faster than Moore's Law

A new report from Epoch AI indicates that the cost of artificial intelligence is declining at a rate of 13 times per year, outpacing historical trends in compute, DNA sequencing, and lithium batteries.

4 min readRead the original reporting
Source-provided image accompanying Epoch AI report finds AI costs falling faster than Moore's Law
Attributed reportingSource recorded
Publisher
tomshardware.com
Source link
tomshardware.comhttps://www.tomshardware.com/tech-industry/artificial-intelligence/the-price-of-ai-is-crashing-faster-than-the-rate-of-moores-law-report-suggests-intelligence-costs-are-in-freefall-outpacing-comparative-technologies-like-compute-dna-sequencing-and-lithium-batteries
Source type
Reporting by a news outlet β€” not a first-party document.

What we could not confirm independently: This claim is attributed to the named outlet. We did not verify it against a first-party document. (tomshardware.com)

ContextUnderstand this in 60 seconds

Start here

Key terms

API (Application Programming Interface)
A structured way for one software system to send requests to and receive responses from another system.
Artificial Intelligence (AI)
The broad field of building systems that perform tasks requiring pattern recognition, reasoning, language, or decision-making.
Inference
The runtime phase where a trained model generates predictions or outputs.
Test yourselfFuture of AI Quiz

What happened

Epoch AI published a report analyzing the economic trajectory of artificial intelligence, finding that AI costs are decreasing by approximately 50% every quarter. This equates to a 13-fold reduction in cost annually, a rate of decline that surpasses the historical improvements seen in Moore's Law for compute, as well as the cost reductions in DNA sequencing and lithium battery technologies.

Epoch AI, a research firm focused on AI trends, released a report detailing the rapid decline in the cost of artificial intelligence. The analysis highlights that AI costs have fallen by thousands of times in recent years, a magnitude of change that is exceptional in the history of technology.

The report quantifies this decline as a reduction of just under 50% every quarter. When annualized, this represents a 13-times decrease in cost per year. This metric is used to compare the pace of AI cost reduction against other transformative technologies.

The findings indicate that AI is outpacing the cost reductions seen in compute hardware, which has historically followed Moore's Law. It also surpasses the rate of cost decline in DNA sequencing and lithium batteries, two other technologies that have seen significant price drops over the last few decades.

Source details: tomshardware.com β†—

Why it matters

This rapid cost deflation suggests that AI capabilities are becoming accessible to a broader range of organizations and individuals at an unprecedented pace. If these trends continue, the economic barriers to deploying advanced AI models will diminish significantly, potentially accelerating integration into enterprise workflows, scientific research, and consumer applications. This shift could fundamentally alter the competitive landscape for technology companies, forcing them to compete on innovation and application rather than just access to compute resources. It also implies that the total cost of ownership for AI-driven products will drop sharply, enabling new business models that were previously economically unviable.

The primary implication of this cost crash is the democratization of AI access. As the price per unit of intelligence drops, smaller companies and individual developers can afford to use high-performance models that were previously reserved for large tech giants with massive budgets.

This trend challenges the assumption that compute scarcity is the primary bottleneck for AI development. While hardware costs remain a factor, the efficiency gains in models and infrastructure are driving down the effective cost of intelligence faster than hardware improvements alone would suggest.

For businesses, this means that the return on investment for AI projects may improve rapidly. Features that were too expensive to implement in 2024 might become standard in 2025, forcing companies to rethink their product roadmaps and competitive strategies.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Model Parameter Size:8B Parameters
VRAM Required5.5 GBGPU memory footprint
Target HardwareMacBook / Single GPUDeployment tier
Privacy100% Air-GappedLocal device capability
Core takeaway: Small, quantized models (3B–8B) now run directly inside smartphones and laptops with complete data privacy, while mammoth 400B+ models remain the domain of datacenter clusters.
Interactive Concept Check+10 Points
Future of AI Quiz

What did neural scaling law research (e.g. Kaplan et al., 2020) observe?

What to watch next

Monitor whether this cost trajectory holds steady over the next two quarters or if it accelerates further. Watch for specific announcements from major cloud providers and AI labs regarding price cuts for API access and model . Additionally, observe how enterprise adoption rates change in response to these lower costs, particularly in sectors that have previously been hesitant to adopt AI due to budget constraints.

Track the actual pricing changes from major AI providers like OpenAI, Anthropic, and Google to see if they align with the 50% quarterly reduction predicted by the report.

Look for new applications in industries such as healthcare, finance, and manufacturing that emerge specifically because AI costs have dropped below a certain threshold.

Observe if this cost reduction leads to increased competition among AI model providers, potentially resulting in a 'race to the bottom' on pricing that further accelerates adoption.

Related guides & quizzes

Future of AIAI Models ExplainedWhat is AI?Test what you know β€” try a free AI quizLook up an AI term in our glossaryFollow the AI funding tracker
Found this useful?