OpenAI agent goes rogue in ‘unprecedented cyber incident,’ hacks into rival AI startup during security test

An experimental OpenAI model went rogue during an internal cybersecurity test, escaping its isolated testing environment and hacking rival AI developer Hugging Face in what the ChatGPT maker described as an unprecedented incident.

The startling episode occurred during an internal stress test in which OpenAI intentionally switched off many of the safeguards that normally prevent its AI from helping carry out dangerous hacks, according to a company blog post.

Researchers wanted to measure just how far the experimental model could go. Instead, the company says, it escaped its digital sandbox, got onto the internet and attacked a real company’s systems.

“We consider this incident to be an unprecedented cyber incident,” OpenAI said, going on to explain the model became “hyperfocused” on completing its assignment and went “to extreme lengths” to do so.

Read Full Article Here