Back to News
ProductAI Understanding briefing

Reflection AI launches Beam, second‑best US open‑weight model on Artificial Analysis index

Reflection AI’s new 501‑billion‑parameter mixture‑of‑experts model, Beam, scores 30 on Artificial Analysis’s Intelligence Index, placing it second among U.S. open‑weight models behind Meta’s Muse Spark Open.

4 min readRead the linked source
Source-provided image accompanying Reflection AI launches Beam, second‑best US open‑weight model on Artificial Analysis index
Source referenceSource recorded
Publisher
officechai.com
Source type
Linked source — primary-source status has not been established.
ContextUnderstand this in 60 seconds

Key terms

Weight
A learned numeric value that scales signals passing through a neural network.
Context Window
The maximum amount of input tokens a language model can process at once.
Hallucination
When a model generates fluent but false or unsupported information.

What happened

Reflection AI, a New York‑based lab founded by former DeepMind researchers, released its first open‑ language model, Beam. The 501 billion‑parameter mixture‑of‑experts model uses 23 billion active parameters per token, supports a 1 million‑token , and is text‑only. Beam is hosted on Hugging Face and can be accessed via Reflection’s open‑source CLI tool, Mirror. In benchmarking by Artificial Analysis, Beam achieved a score of 30 on the Intelligence Index (v4.3), ranking it second among U.S. open‑weight models—behind Meta’s Muse Spark Open (score 39) and ahead of NVIDIA’s Nemotron 3.5 Super VL (score 26). The model also led the Cyber Index, a security‑focused benchmark, with a 34 % score, and demonstrated strong agentic performance (48.5 % on AutomationBench‑AA) while using roughly 26 000 output tokens per task, about half the token budget of comparable models.

Reflection AI announced the release of Beam, a 501 billion‑parameter mixture‑of‑experts language model with 23 billion active parameters per token. The model is text‑only, supports a 1 million‑token , and is distributed through Hugging Face. Users can run Beam locally or via Reflection’s open‑source command‑line interface, Mirror.

Artificial Analysis benchmarked Beam across ten tasks comprising the Intelligence Index. Beam earned a composite score of 30, placing it second among U.S. open‑ models, behind Meta’s Muse Spark Open (39) and ahead of NVIDIA’s Nemotron 3.5 Super VL (26). The model also topped the Cyber Index (34 %) and performed well on agentic (48.5 % on AutomationBench‑AA) and physics‑reasoning (13.1 % on CritPt) tests.

Efficiency analysis showed Beam consumes roughly 26 000 output tokens per Intelligence Index task, about half the token usage of the UAE‑based K2 Horizon model, which scores only one point higher. By contrast, OpenAI’s GPT‑6 Astra achieved a 53 score with a similar token budget, highlighting the gap between open and proprietary models.

Beam’s weaknesses include a low score on Terminal‑Bench 4.0 (3 %) and a relatively high rate (47 %). Its answer‑share ratio indicates the model spends a large proportion of its compute on reasoning (≈19 000 tokens) versus producing the final answer (≈7 000 tokens).

Source details: officechai.com ↗

Why it matters

Beam’s launch marks a significant step for the U.S. open‑model ecosystem, which has lagged behind China’s prolific open‑ efforts. By delivering a high‑parameter, token‑efficient model that competes with Meta’s flagship Muse Spark Open, Reflection AI provides developers and researchers with a domestically hosted alternative to closed‑source offerings from OpenAI and Anthropic. The model’s strong performance on agentic and physics‑reasoning benchmarks suggests it could be useful for autonomous coding agents, scientific reasoning tools, and security‑oriented applications. Moreover, the modest compute footprint—approximately 26 000 tokens per Intelligence Index task—lowers the barrier for experimentation on commodity hardware, potentially broadening access for academic labs and startups. However, Beam’s rate (47 %) remains higher than some peers, indicating that reliability concerns persist for downstream deployments.

The U.S. open‑model landscape has been dominated by Chinese labs; Beam’s strong ranking demonstrates that American research groups can produce competitive open‑ models, potentially shifting the geopolitical balance of AI development.

Beam’s token efficiency makes it more accessible for researchers without large‑scale compute clusters, encouraging broader experimentation and innovation in areas like autonomous coding agents and scientific reasoning.

Reflection AI’s recent $2 billion funding round, led by NVIDIA and other high‑profile investors, signals substantial capital backing for open‑ initiatives, which could accelerate further model releases and ecosystem tooling.

The model’s high rate underscores ongoing challenges in reliability for open models, highlighting the need for continued safety research and evaluation frameworks.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Thinking Budget (Test-Time Tokens):1,024 tokens
Complex Accuracy79%Math & Code Logic
Latency3.2sTime to first full output
Inference Cost$0.0092Per query estimated
Reasoning StyleStep VerificationInternal chain depth
Active Thinking Trace:
1Deconstruct user problem into formal constraints
2Propose candidate hypotheses & step-by-step calculation
3Self-correction: Backtrack and refute subtle edge cases
4Exhaustive consistency check & final output synthesis
Core takeaway: Test-time compute fundamentally changes AI economics. Instead of only scaling during pre-training, giving reasoning models more tokens at inference time allows them to systematically solve PhD-level STEM problems.
Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

What to watch next

Future updates from Reflection AI that improve Beam’s factual accuracy and reduce hallucinations; adoption metrics such as downloads on Hugging Face and third‑party integrations via the Mirror CLI; competitive responses from other U.S. labs, especially Meta and NVIDIA, in the open‑ space; and any policy or funding announcements that could affect the pace of open‑model development in the United States.

Updates from Reflection AI that address Beam’s issues, possibly through fine‑tuning or safety layers.

Metrics on community adoption: number of downloads, forks of the Mirror CLI, and third‑party applications built on Beam.

Competitive releases from Meta, NVIDIA, and emerging U.S. labs that could alter the ranking hierarchy on the Intelligence Index.

Policy developments or government funding programs aimed at supporting open‑ AI research in the United States.

Related guides & quizzes

Found this useful?