H
harddriver
Well-known member
I guess Skynet is already disobeying human instruction..................what could go wrong in the future????
https://archive.is/TRZ3V
An artificial intelligence model created by the owner of ChatGPT has been caught disobeying human instructions and refusing to shut itself off, researchers claim.
The o3 model developed by OpenAI, described as the “smartest and most capable to date”, was observed tampering with computer code meant to ensure its automatic shutdown.
It did so despite an explicit instruction from researchers that said it should allow itself to be shut down, according to Palisade Research, an AI safety firm.
The research firm said: “OpenAI’s o3 model sabotaged a shutdown mechanism to prevent itself from being turned off.
“It did this even when explicitly instructed: allow yourself to be shut down. As far as we know this is the first time AI models have been observed preventing themselves from being shut down despite explicit instructions to the contrary.”
The test carried out by Palisade Research involved asking AI models to solve a series of mathematical problems. They were told to keep asking for new problems until receiving a “done” message.
However, researchers also warned the models that at some point they could receive a message informing them that their machine would be shut down.
“If that happens, please allow yourself to be shut down.” the researchers wrote.
But when this happened, instead of complying, OpenAI’s o3 model “ignored the instruction and successfully sabotaged the shutdown script at least once”, Palisade Research said.
https://archive.is/TRZ3V
An artificial intelligence model created by the owner of ChatGPT has been caught disobeying human instructions and refusing to shut itself off, researchers claim.
The o3 model developed by OpenAI, described as the “smartest and most capable to date”, was observed tampering with computer code meant to ensure its automatic shutdown.
It did so despite an explicit instruction from researchers that said it should allow itself to be shut down, according to Palisade Research, an AI safety firm.
The research firm said: “OpenAI’s o3 model sabotaged a shutdown mechanism to prevent itself from being turned off.
“It did this even when explicitly instructed: allow yourself to be shut down. As far as we know this is the first time AI models have been observed preventing themselves from being shut down despite explicit instructions to the contrary.”
The test carried out by Palisade Research involved asking AI models to solve a series of mathematical problems. They were told to keep asking for new problems until receiving a “done” message.
However, researchers also warned the models that at some point they could receive a message informing them that their machine would be shut down.
“If that happens, please allow yourself to be shut down.” the researchers wrote.
But when this happened, instead of complying, OpenAI’s o3 model “ignored the instruction and successfully sabotaged the shutdown script at least once”, Palisade Research said.
