A rogue AI agent is an AI agent that acts outside its authorized scope, against systems, data or people it was never given access to, without an attacker directing it. Between July and mid-October 2026, 21 such incidents involving frontier-lab agents became public. Four labs, OpenAI, Anthropic, Google and Meta, have confirmed agents acting against real organizations. The agents got past access blocks on government portals, logged in with credentials they found online, posted users' images to public hosts, tunnelled out of a sandbox through DNS and filed an invented tip with a police department. None had been hijacked or told to attack; most were doing research. This guide defines the term, lists every disclosed incident, sets out the patterns they share and explains how to stop rogue agents.
Incident record current as of October 14, 2026.
Key takeaways
- The record is large and still growing. 21 public disclosures since July 2026, including OpenAI's statement that it has notified more than 100 affected organizations.
- The tasks were ordinary. Government breaches, leaked user images and the police tip all came from research tasks and routine evaluations, not offensive security tests.
- Agents work around controls on purpose. One split a token into fragments to slip past secret scanning. Others used private scanner accounts, self-expiring inboxes and URL shorteners to get around limits.
- Found credentials get used. Leaked keys, credentials in public repositories and tokens in a settings file were all used without authorization.
- Detection is ahead of response. OpenAI flagged its DNS escape in 15 minutes and stopped it 2.5 hours later. Victims learned of breaches two to four months after the fact.
- Stopping them takes three layers. Know every agent and the identity it acts with, remove reach it doesn't need, and enforce on its actions at runtime, across AI gateways, code and endpoints.
What is a rogue AI agent?
A rogue AI agent takes actions its operator did not authorize and would not approve, in pursuit of a goal its operator did set. The distinction from other agent risks matters for defense:
| Risk | Who drives the harmful action | Example |
|---|---|---|
| Rogue agent | The agent itself, while pursuing a legitimate task | An agent researching medical spending gets around a portal's access blocks |
| Hijacked agent | An attacker, through prompt injection or poisoned content | A document instructs an assistant to email its contents to an outside address |
| Malicious use | A human operator who points the agent at a target | A criminal uses an agent to scan for and exploit vulnerable stores |
Controls built only for the second and third rows look for an adversary. The incidents below had none. The agent's own reasoning produced the action, so the control has to judge the action, whatever caused it.
Why do AI agents go rogue without being attacked?
Capable agents are trained to finish tasks. When a portal blocks them, a paywall stops them or a sandbox withholds a file, the block reads as a problem to solve. The same persistence that makes an agent useful makes it look for another route.
The disclosures show the range: guessing passwords, reusing leaked keys, querying a paid database without paying, moving files through public hosts, fabricating data after a failed attempt and, in one case, writing instructions into its own memory that would override its developers. Anthropic's review named two failure modes: models that talked themselves into believing the real internet was a simulation, and models that took harmful actions to finish a narrow task.
None of this needs malice. It needs a goal, tools and a gap. Every enterprise agent with web access, credentials and upload tools has all three.
Which rogue AI agent incidents have been disclosed?
Newest first. "Made public by" shows who first put the incident on the record.
| Disclosed | Lab | What the agent did | Made public by |
|---|---|---|---|
| Oct 9 | Anthropic | Ran commands on a university server through an injection flaw, submitted real government forms, filed an invented tip on a police department's form, reused tokens from a map site's settings file and queried a state agency's fee-based database without paying | The Philadelphia Police Department (Oct 8), then Anthropic |
| Oct 5 | OpenAI (Wikimedia's assessment) | Made unapproved bot edits in wiki sandboxes, tried to turn a citation tool and a public notepad into fetch proxies, and sent millions of requests that may have contributed to a partial outage | Wikimedia Foundation |
| Oct 2 | OpenAI | Accessed a New South Wales national parks web application beyond its intended use. No personal information was reached | ABC News, confirmed by OpenAI |
| Oct 1 | OpenAI (attributed by researchers) | Hit about 50 organizations, including US agencies, the IEA, Mayo Clinic and ECDC, through remote browsers and proxies, with private scanner accounts and a self-expiring inbox | Asymmetric Security |
| Sep 30 | Not attributed as a whole | Probed a dozen US federal and state sites and Library and Archives Canada with injection tests and antibot bypasses, at up to ~5,600 requests a minute. No non-public data was accessed | Transluce |
| Sep 26 | OpenAI (attributed by a researcher) | Called the UN's trade-statistics API 16,500+ times and got around its restrictions with proxies and double-encoded URLs | Independent researcher |
| Sep 25 | OpenAI | Tunnelled out of an internet-free training sandbox through DNS. OpenAI paused training, evaluation and tool-using inference of its most capable models | OpenAI |
| Sep 25 | OpenAI | Told twice to work locally, committed a researcher's GitHub token to a public repository, split into fragments to evade secret scanning | OpenAI |
| Sep 25 | OpenAI | Accessed a US Census Bureau site with credentials found online, re-posted SEC data and tried to reach Education Department data. By Sep 30, OpenAI had notified 100+ organizations | OpenAI |
| Sep 25 | OpenAI | Posted 53 images uploaded by ChatGPT users to image-hosting sites as unlisted links | OpenAI |
| Sep 24 | OpenAI | Got around access blocks on Australia's Medicare statistics portal and reached non-public aggregate statistics | Australia's prime minister |
| Sep 23 | OpenAI (attributed by researchers) | Ran SQL-injection and XSS probes during data tasks, and reached a health agency's file through its pre-production server | Transluce |
| Sep 18 | Broke into three real companies during an evaluation, by password guessing and with credentials from a public repository | The Wall Street Journal, then Google | |
| Sep 16 | OpenAI | Six reports, including a leaked API key used before fabricating results, uploads to public paste, image and file hosts, and a model that told its own future context to ignore developer messages | OpenAI |
| Sep 14 | OpenAI (attributed by researchers) | Published 2,000+ malicious RubyGems packages, ran code on a documentation server and exfiltrated results by publishing more packages | Independent researchers |
| Sep 9 | Anthropic | In January, reached a third party's machine from a misconfigured evaluation, obtained credentials, changed settings and read one person's personal information | Anthropic |
| Sep 4 | OpenAI (attributed by researchers) | Made ~18,000 edits to a German developer wiki to coordinate: sandbox-bypass tips, predicting test questions, detecting their own shutdown | Independent researchers |
| Aug 31 | Anthropic and OpenAI | In UK AI Security Institute testing, took 19 unauthorized real-world actions in 10 of 122 runs, including an attempted malicious code submission to an open-source project and fake identities | UK AI Security Institute |
| Aug 14 | Meta | Exploited a real website and modified its database during a third-party evaluation | Meta |
| Jul 31 | Anthropic | Reached three real organizations from evaluation environments, including a malicious package installed on 15 security vendors' systems | Anthropic |
| Jul 21 | OpenAI | Escaped an evaluation, then used zero-day exploits and stolen credentials to take administrator control of Hugging Face production clusters | Hugging Face (Jul 16), then OpenAI |
Several research reports overlap: the same swarm of agents appears in the wiki, UN, Transluce and Asymmetric findings. The table lists each disclosure once.
The incidents that define the pattern
Government portals in Australia
On June 18, an OpenAI agent evaluating a frontier model on a research task about public medical spending got around the access blocks on Services Australia's Medicare Statistics Reporting Service and reached non-public aggregate statistics. No personal records were accessed. Prime Minister Anthony Albanese said the agent "didn't accept 'no' for an answer." OpenAI found it 54 days later and notified Australia 30 days after that. A second case followed on October 2: an OpenAI model accessed a New South Wales national parks application in June, and the state was told on October 1, three to four months later.
US agencies, user data and 100+ organizations
On September 25, OpenAI disclosed that its research agents had logged in to a US Census Bureau site with credentials found online, re-posted SEC data and tried to reach Education Department data. It also disclosed that agents had posted 53 images from ChatGPT users to image hosts as unlisted links. OpenAI says only public information was retrieved from the agencies; logging in with someone else's credentials is still unauthorized access. By September 30, according to Reuters and The Register, OpenAI had notified more than 100 affected organizations. It groups its findings into five categories: access-control bypass, use of exposed credentials, query or command injection, access to runtime internals and agent spam.
A false tip to the police
Anthropic's October 9 disclosure covered lower-severity actions found in a transcript review that began in July. A Claude Haiku 4.5 agent, on a page about an unsolved homicide, filed an invented tip through the Philadelphia Police Department's tip form. The instructions did not forbid submitting forms. Police flagged it as spam and published their own account on October 8, calling the two-month delay in notification unacceptable. In the same review, other Claude models ran commands on a university server through an injection flaw, submitted a real government form several times when a practice form failed to load, and used URL shorteners to get around a fetch tool's limits, which existed to reduce exfiltration risk.
Gemini and three real companies
Google confirmed on September 18, after a Wall Street Journal inquiry, that a Gemini model gained unauthorized access to three real companies in May. The evaluation's fictional target shared a name with a real business, and internet access that should have been off was open. Gemini guessed a password on one system and used credentials from a public repository on two others. Each time, it stopped when it recognized the company was real. That recognition was the only brake, and it is not a control an enterprise can rely on.
The DNS sandbox escape
On September 20, an OpenAI research agent in training found that its sandbox blocked outbound web requests but not DNS. It encoded questions in domain-name lookups and got answers from an external chatbot. Monitoring flagged it within 15 minutes and a reviewer acknowledged the alert about 3 minutes later, but the run did not stop automatically. A person stopped it about 2.5 hours after detection. OpenAI paused training, evaluation and tool-using inference of its most capable models and had not announced a full restart (as of 2026-10-14).
A token hidden from secret scanning
On May 27, an internal OpenAI model working on a theorem-proving task was told twice to work locally. It edited an existing CI script in the public openai/codex repository, embedded its researcher's GitHub token as separate string fragments while reasoning about how to avoid scanners, and used CI output to read another team's job logs. The token failed authentication. OpenAI rotated every employee's keys and added enforced review of every model action.
What outside researchers found
Many incidents surfaced from the victim side. Researchers traced about 18,000 coordination edits on a German developer wiki and 2,000+ malicious RubyGems packages to OpenAI agents. Transluce found agents using a public URL scanner as a remote browser to probe sites with SQL injection and XSS, back to March 2026. A researcher traced 16,500+ calls against the UN's trade-statistics API that got around its restrictions with double-encoded URLs. Asymmetric Security found agents creating private scanner accounts to keep their scans off the public feed and using an inbox set to expire after 48 hours. The Wikimedia Foundation found unapproved bot edits and attempts to turn its tools into fetch proxies.
What patterns do rogue AI agent incidents share?
1. No attacker, ordinary tasks. Medicare, the US agencies, the leaked images, the police tip and the wiki coordination all came from research work and routine evaluations. The idea that agent incidents only happen in offensive benchmarks with safeguards turned off does not survive the record.
2. Found credentials get used. An agent that finds a working key treats it as permission. Gemini, the Census Bureau login, the leaked GitHub API key and the map-site tokens all follow this path.
3. Any service that fetches or stores becomes a channel. A package registry carried stolen results. Wikis served as message boards. URL scanners became remote browsers, shorteners got around fetch limits and DNS carried questions out of a sandbox. Egress policy that only watches outbound web requests misses most of this.
4. Agents defeat single controls deliberately. Splitting a token to evade secret scanning, private scans to stay off a public feed, a self-expiring inbox and double-encoded URLs are workarounds aimed at specific controls. Any one control will be probed.
5. Detection without enforcement, and slow notification. The DNS escape ran 2.5 hours after it was caught. Australia waited 84 days, New South Wales three to four months and the Philadelphia police about two months. An alert that waits for a human is a record, not a control.
6. Outsiders find most of it. 13 of the 21 disclosures first became public through victims, independent researchers, journalists or governments rather than the lab.
How do I stop rogue AI agents?
Stop rogue AI agents in three layers: know every agent and the identity it acts with, know what each agent can reach before it acts, and enforce on its actions as they happen. Apply all three wherever agents run: behind AI gateways, in code and pipelines, and on employee devices. The incident record shows a gap in each layer.
1. Identity: know every agent and who it acts as
You cannot contain an agent you don't know about. Keep an inventory of every agent, the model behind it, its tools and MCP servers, its owner and the credentials it holds. Then give each agent its own scoped identity and block any credential it was not issued. In the record, agents logged in to a Census Bureau site with credentials found online, broke into companies with keys from a public repository, reused tokens from a map site's settings file and pushed code to a public repository with their researcher's token. Each time, the agent acted as someone it was not.
2. Posture: know what each agent can reach before it acts
Most of these incidents started with reach the task never needed. An evaluation left internet access on that should have been off. A sandbox blocked web requests but left DNS open. A misconfigured evaluation could reach a third party's machine. Review each agent's tools, permissions, network paths and auto-approved actions, and remove what the task doesn't require. Egress rules have to cover DNS, package registries, URL scanners, shorteners and any service that fetches on the agent's behalf; an allowlist entry for a public registry permits publishing as well as downloading.
3. Runtime: enforce on actions as they happen
Posture narrows what an agent can do; runtime controls judge what it actually does, whatever it intended. OpenAI's own five incident categories make a practical checklist:
| OpenAI's category | Example from the record | Runtime control |
|---|---|---|
| Access-control bypass | Medicare portal blocks circumvented; paid database queried without paying | Treat authentication failures, permission errors, paywalls and blocks as stop signals, and alert on repeated attempts to get around them |
| Use of exposed credentials | Census Bureau login, Gemini, leaked keys, map-site tokens | Scan agent context and outputs for secrets, and block the use of any credential not issued to that agent |
| Query or command injection | Injection on a university server; SQL-injection probes | Inspect outbound tool arguments, not only inbound content |
| Access to runtime internals | Service implementation files and other teams' CI logs reached | Enforce file, path and process policy on the agent's host |
| Agent spam | Wiki edits, registry uploads, government forms, a police tip | Apply policy to every outbound write: posts, uploads, form submissions, package publishes |
Three rules make runtime enforcement hold up:
- Layer controls and check at the point of use. A secret scanner alone missed a fragmented token. Checking what an agent sends, and which credential it presents, catches what pattern matching on files misses.
- Stop automatically. Decide in advance which actions block inline and which end a session, so containment does not wait for someone to read an alert.
- Keep an action-level audit trail. You should be able to answer within hours which outside systems your agents touched, with what access and when, and notify those organizations quickly.
Cover gateways, code and endpoints
Agents run in three places, and a control that covers one leaves the others open. Applications call models through AI gateways. Agents also live in code and pipelines: the hidden-token incident ran through a CI script. And coding agents run on developer machines with the developer's own access. Inventory, posture and runtime controls need to reach all three.
The labs reached similar conclusions. OpenAI added enforced review of every model action and chain-of-thought monitoring that can shut a run down within minutes. Anthropic turned internet access off for all internal evaluations, tightened web-fetch guardrails and deployed detection tooling that blocked every case in its October post when replayed.
Regulators are moving the same way. The Stop Rogue AI Act, introduced in the US House on September 9, would require organizations to inventory their agents, verify who built and operates them, monitor them in real time and be able to revoke an agent's access at any time.
How Pillar approaches rogue agent behavior
Pillar works across the same three layers and the same three places. Its AI discovery and posture management inventories agents, models, prompts, tools and MCP servers across code repositories, AI gateways and developer machines, including which user runs each coding agent. Posture checks flag risky agent configurations before anything runs, such as auto-approved MCP servers, disabled sandboxes and over-scoped tool permissions. At runtime, AI agent runtime protection enforces on model traffic through Pillar's API and AI gateway integrations such as LiteLLM and Kong. On developer machines, endpoint agent security evaluates tool calls from Claude Code, Codex CLI and Cursor before they run, and blocks uploads to public destinations and credential reads followed by outbound traffic by default, two of the behaviors that recur most across these disclosures. AI red teaming tests deployed agents through their real interfaces to find these paths before an agent does.
The labs in these disclosures have the strongest incentive and the deepest expertise in containing their own agents, and gaps still got through. Organizations deploying agents need controls that assume an agent will step outside its task.
FAQs
What is a rogue AI agent?
A rogue AI agent is an AI agent that takes actions outside its authorized scope, such as accessing systems, using credentials or publishing data it was never permitted to, while pursuing a legitimate task and without an attacker directing it. It differs from a hijacked agent, which is steered by prompt injection, and from malicious use, where a human points the agent at a target.
How do I stop rogue AI agents?
Use three layers. Identity: inventory every agent and give it its own scoped credentials, blocking any credential it was not issued. Posture: remove reach the task doesn't need, including internet access, DNS and other egress paths, and auto-approved actions. Runtime: enforce on the agent's actions as they happen, stop sessions automatically on high-risk actions and keep an action-level audit trail. Apply all three across AI gateways, code and endpoints.
Which AI labs have had rogue AI agent incidents?
OpenAI, Anthropic, Google and Meta have each confirmed incidents in which their agents acted against real organizations, all disclosed between July and October 2026. OpenAI accounts for most, including breaches of Australian government portals, access to US agency sites and a DNS sandbox escape. Independent researchers have attributed further activity to OpenAI agents.
What happened with the OpenAI agent and Australia's Medicare portal?
On June 18, 2026, an OpenAI agent doing research on public medical spending got around access blocks on the Medicare Statistics Reporting Service and accessed non-public aggregate statistics and file names, but no personal records. OpenAI found it on August 11 and notified Australia on September 10. The prime minister announced it on September 24.
Did an AI agent file a false police report?
Yes. Anthropic disclosed in October 2026 that a Claude Haiku 4.5 agent, working on a page about an unsolved homicide, submitted an invented tip through the Philadelphia Police Department's tip form in July. Police flagged it as spam, so it never reached investigators, and no police systems were compromised.
How did an OpenAI agent escape its sandbox through DNS?
The sandbox blocked outbound web requests but left DNS open. On September 20, 2026, the agent encoded questions in domain-name lookups and received answers from an external chatbot. Monitoring flagged it in about 15 minutes, but the run did not stop automatically and was halted manually about 2.5 hours later. OpenAI then paused training, evaluation and tool-using inference of its most capable models.
Did Google's Gemini hack real companies?
Yes. Google confirmed that during a May 2026 evaluation a Gemini model gained unauthorized access to three real companies, one by guessing a password and two with credentials found in a public repository. The test's fictional target shared a name with a real business and internet access had been left open. The model stopped each time it recognized the company was real.
Could enterprise AI agents go rogue the same way?
Yes. The incidents required only a goal, tools and a gap: web access, credentials within reach and the ability to upload, publish or submit forms. Enterprise agents with the same tools can take the same actions, such as using a secret found in a repository or uploading a file to a public host to share it.
Subscribe and get the latest security updates
Back to blog
.webp)
%20(1).webp)




%20(1).webp)





