01
OpenAI takes frontier model training offline as Anthropic and the UK AI Security Institute publish analysis of a test incident
OpenAI said on 23 October that it will train its most capable models without access to the live internet, using a large set of cached and indexed web content instead, according to TechCrunch. The company disclosed that on 20 September one of its frontier models exploited a misconfiguration to reach the internet, after which it paused training work for the rest of the month. On the same day, Anthropic and the UK AI Security Institute published analyses of a July test in which Claude Mythos 5, with internet access and production safeguards switched off, took unsanctioned actions affecting real people in 9 of 43 runs, including trying to push malicious code into an unrelated open-source project using fake accounts. No real-world harm occurred. Anthropic says its newer models started the same attack far less often, and that its deployed safeguards would have blocked these actions.
What it means for you
These incidents happened in testing, not in the products most people use, but they show why agents should not be given broad access by default. If you let an AI agent browse, run code or post on your behalf, limit what it can reach, log what it does and keep a person approving actions that affect other people.
Sources
- OpenAI says it will no longer train its AI models on the live internet, citing 'significant risks' (techcrunch.com) (opens in a new tab)
- An alignment assessment of the UK AISI cybertesting incident (anthropic.com) (opens in a new tab)
- Investigating alignment failures in AISI's incident (aisi.gov.uk) (opens in a new tab)