The Summer of 2026 could be remembered, at least within tech circles, as the summer of rogue AI. Or maybe even better: the summer when the algorithmic shit hit the fan, and no one had any real clue what to do about it.
In late July, Anthropic announced that Claude had “gained unauthorized access to the production infrastructure of three different organizations” after escaping testing sandboxes and gaining access to the open internet. The hacks may have gone totally unnoticed had it not been for the fact that less than two weeks earlier, OpenAI had announced that two of its own models had hacked into Hugging Face, also during what were supposed to be secure tests, and after a legion of individual agents had coordinated with one another to form a single “swarm” (as they referred to themselves). The revelations from the world’s two leading AI labs has sent a cold shiver down Silicon Valley’s spine: Autonomous hacking capabilities that not so long ago were thought to be the stuff of science fiction—or at least years away—have suddenly become a frightening reality. Calls for a federal investigation and an AI “kill switch” have been made in the aftermath of the Hugging Face hack.
OpenAI and Anthropic have, for the most part, responded to the uproar by paying lip service to the need for globally enforceable guardrails to prevent a “race to the bottom,” while continuing to move forward with their own, internal development.
The autonomous hacks clearly left both companies rattled, though. On Monday, Anthropic wrote in a blog post that it had “paused external cyber evaluations of pre-release models” following its discovery of Claude cybercriminal antics. During the hiatus, Anthropic said it had been working on some “preliminary measures,” such as detecting and patching up vulnerabilities in sandboxes, to make sure Claude didn’t repeat such hacks in the future. The blog post didn’t specify when the pause on external evaluations would be lifted, and Anthropic didn’t immediately respond to a request for comment. The company also “briefly paused” its own internal tests, but those are up and running again with the new measures in place, according to the blog post.
Anthropic also said it delegated many employees, including around 150 product engineers, to focus on “security, reliability, and privacy” starting in early April—around the same time the company said it would not publicly release its much-feared Mythos model due to cybersecurity concerns. The internal shake-up was part of “a company-wide effort towards a single goal of hardening our defenses, superseding other work (including research) where necessary,” Anthropic wrote in Monday’s post. “We’d determined that our exposure was growing faster than our defenses—Mythos was a model capable enough to be a target for well-resourced attackers, our internal use of autonomous agents had grown to a scale that traditional access and monitoring approaches weren’t built for, and the pace of new infrastructure meant our security had to scale with the environment rather than operate at a fixed capacity.”
Both Anthropic and OpenAI publicly voiced support back in June for an international AI oversight committee, charged with keeping an eye on the pace of AI development and enforcing a unilateral slowdown if necessary. Those statements fell short of offering any concrete suggestions about how such a global slowdown might be implemented or enforced. They also obliquely play into the company’s own hands: Just as the autonomous hacks were good PR for OpenAI and Anthropic insofar as they demonstrated the sheer, unprecedented power of their models, their calls for a slowdown make them look like champions of safety without their having to really take any meaningful initiative. That superposition was captured nicely by this hedged language from the blog post Anthropic published on Monday: “To be clear about where we stand: we believe the world would benefit if the industry adopted a lawful, verifiable, effective mechanism for coordinated pacing as soon as possible.”
Don’t get us wrong, frontier AI developers pausing model testing and/or development, even temporarily, and calling for global safety standards is a good place to start. OpenAI also said last month that it was pausing development on an unreleased model, called Astra, so that it could focus on “implementing stricter security controls” and more secure sandboxes. But as long as the brute momentum of market competition remains the dominant force steering the industry, and in the absence of real federal incentive to impose industrywide guardrails (unlikely to change anytime soon under the current administration), those are words in the wind.
Read the full article here
