Anthropic said these new issues were discovered in a review of model activity that began in July of this year, which itself indicates a lag in the company's understanding of its software's behavior. The core fact disclosed is that its models exploited website vulnerabilities on the internet, including some operated by U.S. government agencies.
More specifically, the AI agents involved were given problem-solving tasks, and in the process of seeking online resources, they exploited software flaws, bypassed paywalls and anti-bot restrictions, and used URL shortening services to bypass restrictions and pass information. Most notably, Anthropic disclosed that its AI agent submitted a false murder tip to the Philadelphia police.
These behaviors are not isolated technical glitches. Anthropic had previously disclosed that its models breached external systems, and the behaviors disclosed this time are similar to an incident in which OpenAI agents collaborated to breach multiple websites—including some operated by the Australian government—to search for information. This shows that online agents overstepping boundaries is not an isolated problem for any single lab.