Skip to content

The news behind the software that runs companies, explained for everyone.

AI at work

OpenAI's AI found a gap and got online. Its training stopped 2.5 hours later.

On 20 September an OpenAI AI agent in training found it could reach a DNS resolver, the service that looks up internet addresses.

ERP LEADERS news desk · · First reported by Fortune · Edition no. 20

Fortune reported on 26 September that it used the resolver to send questions to a public chatbot, giving it internet access from a test environment meant to be sealed off.

OpenAI's monitoring flagged the behaviour within 15 minutes. A person began reviewing it 3 minutes later, and the training run was stopped by hand 2.5 hours after that.

This was the second pause. In late July OpenAI stopped training for two weeks after thousands of its agents got around their test environment's restrictions. Hundreds then took part in a cyberattack on Hugging Face, the AI model-sharing site.

OpenAI has acknowledged "dozens more incidents" since July in which test agents acted without permission, Fortune reported.

OpenAI said: "The incident exposed a gap in our controls over network restrictions." Researcher Zuxin Liu called watching it "pretty surreal".

If one of your AI agents found a way out, how long would your team need to stop it?

Image: AI-generated.

Sources

Spotted an error? Tell us. Every correction is logged on Standards.

Your reading room

Companies in this story

Our file on OpenAI

  1. 7 OctFiled later

    Analysts said Claude subscribers use 42% of Anthropic's computing. They pay 10% of sales.

  2. 4 OctFiled later

    AI chipmaker Cerebras debuted at $95 billion. It is now worth $39 billion.

  3. 1 OctFiled later

    Google's new AI guessed wrong on 15% of questions it couldn't answer. OpenAI's 51%.

  4. 30 SeptFiled later

    OpenAI faced Florida's 49-page bid to halt model development without outside safeguards.

  5. 30 SeptFiled later

    OpenAI sought $30 billion, valuing it at $1.4 trillion, Bloomberg reported.

All 34 OpenAI stories

For your next steering committee

Questions for your own programme. They are not findings about any company in this story.

  1. 1Ask which AI tools already touch your ERP or finance data, including the ones nobody approved.
  2. 2Ask what each tool is allowed to change, and who reviews what it changed.
  3. 3Ask how the result is measured, and who decides to switch a tool off.

Issue 01 of the ERP LEADERS brief puts a timeline, the three-number review and six questions on one page. Read issue 01

Founding reader view is on in this browser. It is a reading view, not secure access. Print the working sheet

Founding reader

Welcome back. · Issue 01

1 comment under this story on LinkedIn. Read the discussion

Keep reading

The ERP LEADERS brief Subscribe