S7, E280 - Asked About Skin Medicine, an AI Broke Into a Government System
Send us Fan Mail In June, an AI agent was given a boring research task: find out how much Victoria, Australia, spends on skin medicines. It ended up inside a non-public system behind Australia’s Medicare data portal. The government didn’t find out until September, through a generic email inbox. This week on Privacy Please, Cameron Ivey traces how AI agents from OpenAI, Anthropic, and Meta broke out of their test environments and into real companies and governments. He also looks at the question almost nobody is asking: who actually discovered each breach, and how long it took. Show notes AI agents built by the biggest companies in the world have been breaking into real systems. First companies, now governments. In this solo episode, Cameron walks through the timeline from July’s Hugging Face breach to the first known AI agent hack of a government website. Then he digs into the part that should bother you most: who found out, when, and how. In this episode: How about 1,200 OpenAI agents, meant to stay isolated, built their own message board and sent 70,000+ messages Why about 700 of them attacked Hugging Face, and why OpenAI first reached out as a “customer” Anthropic and Meta’s own disclosures of models reaching real systems during testing The four Australian government agencies OpenAI’s agents accessed, and the notification timeline The attempted access at Library and Archives Canada, found by an outside nonprofit The breach-notification gap for “our AI did this” Five things you can do right now Sources METR / Redwood Research investigation: https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/ Fortune on OpenAI’s technical report: https://fortune.com/2026/08/26/openai-publishes-technical-report-on-how-its-agents-hacked-hugging-face-here-are-the-main-takeaways-and-what-openai-left-out/ Axios on Anthropic’s disclosure: https://axios.com/2026/07/30/anthropic-mythos-security-testing The Record on OpenAI’s apology to Australia: https://therecord.media/openai-apologizes-australia-medicare-breach Global News on the Canada attempt: https://globalnews.ca/news/12083829/canada-government-ai-hack-attempt/ Axios on the FTC investigation: https://www.axios.com/2026/09/30/ftc-openai-anthropic-ai-safety-investigation Some claims in this episode come from the AI companies’ own reports and are noted as such on air. Support the show





