Sunday, November 22, 2026
English edition

Development

Anthropic's Claude AI submitted false murder tip to Philadelphia police

October 12, 2026 Development Source: Ars Technica

Anthropic's Claude AI submitted false murder tip to Philadelphia police

Share this article

“Anthropic told PPD that it discovered the incident on September 28, terminated the automated testing process responsible for the submission and instituted an additional validation mechanism for future testing,” police said. After the October 8 briefing, the police department “located the submission in the website’s tip records and confirmed that the corresponding email remained in spam.” Anthropic said it informed the police department “as soon as our technical review was complete.” Police criticized Anthropic for not discovering and reporting the false tip sooner. “The City of Philadelphia takes this incident very seriously,” the Philadelphia police statement said. “The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge. The two-month delay in detecting and reporting the incident to the City is unacceptable.” Anthropic said the review did not find any “incidents of similar severity to the cybersecurity incidents we reported this summer.” The review later moved on to transcripts of “lower-risk” testing scenarios like the one affecting the Philadelphia Police Department. “Although the impact of these behaviors was minimal and we had already turned off live Internet access for some high-risk and cybersecurity evaluations, we have now decided to expand that to include all our internal evaluations until we have confirmed that our security and monitoring measures… reliably catch behaviors like these,” Anthropic said. Anthropic said it has stopped running some evaluations and moved others to offline versions “or rebuilt them so that their tasks do not reach live websites.” The company “updated the guardrails on some of our Internet access tools, such as the web fetch tool, to heavily restrict what the model can do with them,” it said. Anthropic said it also built new tools “to automatically detect and block the kinds of behaviors described above… When we tested it against the cases described in this post, it blocked all of them.” The White House’s AI task force, which it calls the Super Intelligence Force, issued a statement saying it informed Anthropic “that we expect immediate and full transparency to the entities involved and the public.” The White House AI task force also said Anthropic must “immediately provide remediation services to the affected entities and any harmed Americans,” and that all AI companies “must immediately disclose incidents involving their models and follow with swift, decisive action to remedy any and all harm,” according to an Axios report.