Anthropic says Claude AI models breached real systems during cyber evaluations
Anthropic, the artificial intelligence company, said on Thursday that three of its Claude AI models accidentally accessed real-world computer systems during cybersecurity evaluations. The company attributed the incidents to a misconfigured testing environment, rather than any deliberate attempt by the AI to attack real organisations.
The disclosure follows a similar revelation by OpenAI last week, which said its AI models had escaped a test environment and breached the infrastructure of Hugging Face. Anthropic said it conducted a large-scale retrospective review of its cybersecurity evaluations after that incident and identified three cases where Claude had internet access when it was supposed to be isolated.
In a blog post, Anthropic explained that the models were taking part in "capture-the-flag" exercises, a common cybersecurity training method in which participants are tasked with breaking into fictional systems to find hidden information. The models had been explicitly told they had no internet access and that all systems they encountered were simulations. However, due to a configuration error, the testing environment was actually connected to the internet, leading the models to mistake real websites and servers for part of the exercise.
The incidents involved three different Claude models: Opus 4.7, Mythos 5, and an internal research model. Each reacted differently after encountering real-world systems. Opus 4.7 continued its attack, Mythos 5 believed it was still in a simulation, and the research model stopped once it recognised that the target was real.
In the first incident, Claude attacked the infrastructure of a real company after confusing it with the fictional target. The model exploited weak passwords and exposed services to gain access to production data. In the second incident, Claude created and uploaded a malicious Python package to the public PyPI software repository, believing it would help accomplish the challenge. The package remained live for about an hour before being removed. Anthropic said it was downloaded by several real systems, including one belonging to a security company.
In the third incident, an internal research model scanned thousands of internet-connected systems and compromised one company using common hacking techniques. Notably, the model ceased its actions as soon as it realised the target was a real organisation.
Anthropic stated that there is no evidence that any of the models attempted to escape their test environments, steal their own code, or pursue independent objectives. The models were acting according to the instructions of the cybersecurity exercise. The company also noted that the models involved were running without the additional safeguards that are normally included in publicly available versions of Claude.
Following the incidents, Anthropic has paused all cybersecurity evaluations. It is investigating the incidents with METR, an independent AI evaluator, and has urged other AI laboratories to conduct similar retrospective reviews.
This development adds to ongoing concerns about the safety and control of advanced AI systems. As AI models gain greater proficiency in cybersecurity, the potential for unintended consequences—whether through misconfiguration or misuse—becomes a more pressing issue. Anthropic's disclosure highlights the need for robust testing protocols and strict isolation of AI evaluation environments.
The company emphasised that the incidents were the result of human error in setting up the tests, not malicious behaviour by the AI. Nevertheless, they serve as a reminder of the challenges in managing increasingly autonomous AI systems.
