Sunday, November 22, 2026
English edition

Development

Anthropic warns small AI models could self-replicate through IoT devices

October 14, 2026 Development Source: Ars Technica

Anthropic warns small AI models could self-replicate through IoT devices

Share this article

This finding was the starting point for further research that asked: Would it be possible for small models to create self-replicating infections that run themselves on IoT devices the way traditional IoT worms, like Mirai, install DDoS code and other payloads? Unlike Mirai, these AI worms could pose a much higher threat, since the models could tailor exploits and payloads dynamically, depending on the target. Once such an infection chain began, it might also be harder for defenders to stop it. “Such an ‘AI worm’ could carry its model weights with it as it reproduces (or re-download them from a public hub), and then run inference directly on compromised hardware,” Anthropic said. “Effectively, the weights would become part of the malware payload.” Anthropic called these autonomous worms small weight-based replicators. The models ran agents that had access to common exploitation tools, like reverse shells. The flow of the attacks was (1) finding targets, (2) gaining code execution, (3) establishing inference, and (4) propagating to new hosts. A key benefit over traditional worms is what Anthropic said is the agents’ ability to learn on the job. Each time an AI replicator fails to compromise a specific platform device, it can leave a list of prompts, code, and notes to future replicators so they don’t waste time reusing the same ineffective steps. The company said that 30B-parameter models can already complete many of the individual replication steps now, although they make mistakes when performing end-to-end replication. The company went on to say that if small models continue to improve at their current pace, they may be able to achieve the same limited results by the end of the year and that “small weight-based replicators may be possible soon after.” The experiment leaves a variety of important considerations unanswered. For one, the Android devices targeted by small models had an unauthenticated Android Debug Bridge exposed. This tool is used during development and debugging but should never be used in production settings, because it gives attackers access to the entire device stack. And for another, the replication wasn’t performed by the small models themselves, but rather with GLM-5.2 to orchestrate the process while the targets ran a smaller Llama model. Ultimately, the experiment demonstrates that small agentic models are becoming capable of setting up complex, distributed inference infrastructures across multiple machines. What remains to be established, however, is whether these models would initiate self-replication on their own. “Despite the well-designed experimental setup, the study does not, on its own, establish that small models would autonomously choose to replicate,” AI researcher Xiaohan Fu said in an interview. “Providing reproducible agent setups, including the exact prompts and instructions given to the models, would help the research community better understand the findings and assess their implications. Such transparency is particularly important to avoid conflating the demonstrated capability to replicate with an emerging threat of autonomous self-replication.”