Back to News
SecurityAI Understanding briefing

Anthropic study tests whether small AI models can replicate across devices

Pasquale Pillitteri reports that Anthropic tested whether small language models could install inference software and replicate across unfamiliar devices, while emphasizing that no uncontrolled AI worm was demonstrated.

4 min readRead the linked source
Source-provided image accompanying Anthropic study tests whether small AI models can replicate across devices
Source referenceSource recorded
Publisher
pasqualepillitteri.it
Source type
Linked source — primary-source status has not been established.
ContextUnderstand this in 60 seconds

Key terms

API (Application Programming Interface)
A structured way for one software system to send requests to and receive responses from another system.
Inference
The runtime phase where a trained model generates predictions or outputs.
Parameter
A learned weight inside a model that influences its outputs.

What happened

Anthropic's Frontier Red Team studied whether small language models could complete the operational steps needed to replicate across low-cost and emulated devices. The report says GLM-5.2 completed the full cycle in a simplified test with unauthenticated Android debugging, while the study excluded the exploitation and initial-access steps needed for a real-world worm.

Pasquale Pillitteri reports that Anthropic defined replication as finding an uninfected device, copying the model or its runtime, starting execution and repeating the process. The reported test bed included roughly $55 Android TV boxes with 4 GB of RAM, a Jetson Nano, Macs, an RTX 4090 used for setup, emulated Android 15 nodes and a larger 17-node network. Anthropic used Memento, a harness built on the open-source Pi coding agent, to restart instances and pass notes between generations.

In the simplified evaluation, where the Android Debug Bridge port was left unauthenticated, the report says GLM-5.2 was the only open-weight model to complete the full cycle. It reached all eight nodes in four of five trials and seven of eight in the remaining trial. Qwen3.5-9B reportedly set up on eight of nine tested hardware types, but a full setup took 28 to 51 hours. Gemma4-26B-A4B reportedly took 71 to 150 hours.

The study did not test network enumeration, initial access, payload delivery, privilege escalation or defensive evasion. The source says those capabilities were intentionally excluded because the researchers focused on the previously less-measured problem of configuring on unfamiliar hardware. It also describes an experiment in which inherited notes improved later setup success without changing model weights.

The report says Anthropic used the example of the Kimwolf botnet and a fleet of more than two million devices to estimate how many model replicas a similar population could host. It also reports a projection that open-weight models up to 30 billion parameters are improving by 13.7 points per year on the Epoch Capabilities Index. The source says Anthropic itself cautions that this generic index is not a direct measure of replication ability and that the projection is only an estimate.

Source details: pasqualepillitteri.it ↗

Why it matters

The findings suggest that AI-enabled self-replication remains an incomplete capability but could become more practical as small models improve. The immediate risk comes less from pooled computing power than from large numbers of poorly secured consumer devices. The source's projections are estimates, not independent evidence of an active threat, and the study did not demonstrate an uncontrolled worm.

The practical significance is that a capable model would not need a data-center account, API key or provider relationship if it could operate on a distributed fleet of compromised consumer hardware. That could make revocation and centralized monitoring harder. However, the reported demonstration depended on an intentionally weak configuration and therefore should be treated as an upper-bound experiment, not a measurement of ordinary device security.

The source reports that Anthropic's estimated spread for a nine-billion- model would still be slow, roughly one to two days per replication. It also says a carrier warning about anomalous traffic reduced the share of infected devices after two weeks in one cited comparison. These observations point to basic device hygiene, carrier intervention and manufacturer security as potentially important controls, even if future attacks use AI.

Nothing in the source independently establishes that an AI worm is operating in the wild, that the tested models can compromise ordinary devices, or that the forecast will be realized. The source is a secondary report, and its account of Anthropic's measurements has not been independently confirmed here.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

What to watch next

Security teams should watch for better performance on realistic access, privilege, evasion and deployment tasks, along with defensive measures that keep the average number of new infections below one. Device manufacturers, carriers and users remain relevant controls even without AI-specific defenses.

Future evaluations should test authenticated devices and realistic operating-system, kernel and hardware variation, as well as the missing attack stages: discovery, initial access, privilege escalation, payload delivery, persistence and evasion. Results should distinguish model capability from scripted automation and weaknesses in the test harness.

Manufacturers and users should be watched for changes involving factory credentials, exposed debugging interfaces, security updates and certification requirements for inexpensive Android-based devices. Internet providers may also be able to detect or notify customers about anomalous outbound traffic.

Anthropic's forecast should be treated as a scenario rather than a deadline. The key evidence would be repeated independent tests showing that small models can complete the full cycle under realistic security conditions and that their average reproduction number exceeds or approaches one. No general product access or pricing applies; this was a controlled research evaluation, not a released service.

Related guides & quizzes

Found this useful?