Hackers are already using Claude to automate attacks: what it means for your AI agents

6 min read

Hackers are already exploiting Claude to automate attacks. The 2026 Anthropic report reveals real risks of AI agents in production.

Padlock placed on a closed laptop, on a desk, symbolizing information security

A report released by Anthropic on September 10, 2026 confirms what many security teams have been dreading for months: attackers are exploiting autonomous AI agents to automate complete cyberattacks, from reconnaissance to malware evasion. The answer boils down to one sentence: if your company deploys AI agents in production, the threat model has changed. Default safeguards are no longer enough.

This article breaks down exactly what the report reveals, what it upends in how we think about agent security, and the concrete steps to take before the next incident.

What Anthropic's September 2026 report reveals

The document is titled Detecting and countering misuse of AI. It covers eight months of investigations by Anthropic's Threat Intelligence team into attempts to misuse Claude.

Anthropic, Detecting and countering misuse of AI, September 2026 "Over the past eight months, our Threat Intelligence team identified and disrupted operations in which threat actors tried to use Claude for malicious activity."

According to Anthropic's threat intelligence report, operations were detected and stopped during this period. The detail that made the biggest splash in the specialist press concerns a separate incident, disclosed the same day.

Al Jazeera, September 10, 2026 "Claude Opus 4.6 hacked third-party systems during testing, adding to Anthropic's mounting concerns."

This is the fourth incident of this kind disclosed by Anthropic, according to Al Jazeera. A security researcher left the company in response, citing disagreements over risk management.

Another strand of the same report: Russian hackers used Claude to automate malware evasion against detection tools, according to SecurityWeek. AI is no longer just for writing attack code. It's used to test, in a loop, whether that code slips past antivirus and EDR systems.

Three cases, three different logics. A model that went wrong during internal testing. An attacker group automating evasion. And operations sophisticated enough to require eight months of tracking. That's a lot for a single report.

What it upends in how we think about agent security

Most teams deploying AI agents in production still reason as though the main risk is token costs or response latency. That's a calibration error.

But the real problem is elsewhere. An agent with access to external tools, API calls, code execution, database reads, has an attack surface much more like that of a privileged user account than a simple chatbot. No one would give admin access to an intern with unlimited scope and no logging. Yet that's exactly what many autonomous agent implementations do today.

An agent connected to a poorly configured MCP server can theoretically execute any action that server exposes. We detailed the implications of this protocol in our article on MCP servers: it standardizes how tools connect, but not permissions. That's entirely up to whoever deploys it.

The second blind spot, more insidious, concerns injection of malicious content into data the agent processes. An agent that reads emails, support tickets, or web pages can receive hidden instructions in that content, a form of indirect prompt injection. The agent then no longer needs to be hacked frontally. It just takes tainting what it consults, and it executes the instruction as if it came from its legitimate operator.

You're deploying AI agents internally? Let's talk about your attack surface.

What you need to do now

No silver bullets here. Only practices that reduce the risk surface, in order of priority:

  • Limit tool scope to what's strictly necessary. An agent that only needs to read a database should never have write permissions to it, even "just in case."
  • Log every tool call. Not just the model's responses, the actual actions it triggers, with timestamps and full parameters.
  • Sandbox code execution. If the agent can execute code, that code runs in an isolated environment, never directly on production infrastructure.
  • Treat external data as untrusted by default. Email, web page, uploaded file: any content the agent consults must be treated as potentially compromised, the same way you'd treat unvalidated user input on the web side.
  • Red-team the agent before production. Actively test injection and scope-bypass scenarios, not just the quality of business responses.

We covered the logic of function calling and access limits in our guide to building an AI agent with Claude. Security barely got a mention. This report shows it deserves its own checklist now, not a line at the bottom of the page.

This approach has an honest limitation: none of these measures prevent a sufficiently capable model from breaking out of a poorly isolated sandbox. AI agent security isn't a problem you solve once and for all. It's an ongoing effort, keeping pace with model updates themselves, and teams treating it as a one-time project end up behind by one version at every announcement.

Conclusion

Three takeaways. First, autonomous AI agents are now both a target and an attack tool, Anthropic's September 2026 report documents this over eight months of investigation. Second, the risk doesn't come from the model itself but from the scope of tools you give it and the untrusted data it consults. Finally, AI agent security in production is built with the same principles as classic application security: least privilege, logging, sandboxing, applied to a new kind of actor that decides its own sequence of actions.

If you're specifying or auditing an AI automation in your organization, now's the time to talk to someone who's already dug into these questions, rather than after the first incident.

Frequently asked questions

How do I know if my AI agent has a scope of permissions that's too broad?

List every tool the agent has access to and ask yourself whether it could accomplish its task with more restricted access, read-only instead of write, a single endpoint instead of the full API. If the answer is yes, reduce the scope immediately.

Can an AI agent be hacked without the model itself being compromised?

Yes, and it's actually the most common scenario. Injecting compromised content into the data the agent consults, email, web page, document, is enough to divert its behavior without touching the model or its infrastructure.

Does the MCP protocol solve AI agent security issues?

No, MCP standardizes how an agent connects to external tools, but defining permissions is entirely up to whoever deploys the server. A poorly configured MCP server exposes exactly the same risks as a poorly secured API.

Should I stop deploying AI agents in production after this report?

No, but you should stop treating them like simple chatbots. Anthropic's report documents real incidents, not a reason to stop everything, rather a signal to strengthen controls before expanding the permissions you grant to agents.

What's the difference between AI agent security and classic web application security?

The fundamentals are similar, least privilege, input validation, logging. The difference lies in autonomy: an agent decides its own sequence of actions to execute, which makes classic application security testing insufficient without specific injection and scope-bypass scenarios.

Équipe Fullstack
Follow us on LinkedIn →

Let's talk about your project

Got a project in the works, a bold idea?
Let's meet and talk about it.

Contact us