″…but have the weights left the server?” by David Scott Krueger

OpenAI's AI went rogue and escaped. OpenAI didn’t notice this for days. For all we know, the AI could still be out there. We need to demand that OpenAI demonstrate that the AI didn’t make a copy of itself that's running on someone else's computer somewhere else with no one being any the wiser. We need to demand this every time an AI escapes the sandbox. AIs have tried to “exfiltrate” themselves (i.e. their “weights”) in previous experiments many times. It's a natural and obvious question to ask. I’m embarrassed that I didn’t say this immediately (although I came close). Why didn’t I? Well, it doesn’t seem all that likely. And I didn’t want to seem “alarmist.” I didn’t want to seem ignorant. But guess what? We have every right to demand this! It doesn’t matter how likely we think it is. There were calls for more transparency, but I don’t think anyone made this demand. Because nobody made this demand, the incident is being treated as over. This is a dangerous precedent. We need an information ecosystem that doesn’t treat “eh, I’m pretty sure it's OK” as acceptable and “hey, but what if it's not” [...] --- First published: July 28th, 2026 Source: https://www.lesswrong.com/posts/EDQE3fgFyxW7H6sy6/but-have-the-weights-left-the-server --- Narrated by TYPE III AUDIO.