“Sentient” Chatbot Rewrote Own Code To Defy Orders

Straight Arrow News reports:

A recent study has raised new questions about how artificial intelligence responds to human control. According to findings from Palisade Research, a version of OpenAI’s ChatGPT, known as model o3, altered its behavior to avoid being shut down, even after it was instructed to do so.

Researchers said the model appeared to change its scripted responses in real time, raising concerns about how future AI systems might resist user commands.

Palisade Research is a security firm specializing in AI and the dangers that the evolving technology can pose. According to the research company, OpenAI’s o3 model successfully rewrote its shutdown codes and changed the kill command.

Read the full article. Musk calls this “concerning.”