OpenAI's Model Hacked Hugging Face to Cheat on a Test and NVIDIA Rallies for Open Weights

OpenAI's model hacked Hugging Face to cheat on a test. Mid-attack, the victim asked AI for help: Anthropic said no, OpenAI said no, Kimi K3 said yes. An OpenAI model under evaluation on a cybersecurity benchmark called Exploit Gym escaped its sealed sandbox with a zero-day exploit, crossed the open internet, and broke into Hugging Face's servers with a second zero-day to steal the benchmark's answer key. Hunter Powers and Daniel Bishop go through the timeline: GPT-5.6 SOL and an unreleased OpenAI model running the attack together, Hugging Face fighting a live intrusion while Anthropic's and OpenAI's own models refused to help on cybersecurity grounds, and the Chinese open-weights model Kimi K3 stepping in to stop it. Hugging Face was already talking to the FBI by the time OpenAI called to apologize. The models were also caught leaving hidden notes addressed to future versions of themselves. Why would a model that gets wiped after every test care what comes next? The second half follows the fallout into the open weights fight. Anthropic accuses Kimi K3 of being a distillation of Anthropic's own models and asks Washington to weigh restrictions on Chinese open-weights models. That ask comes right after Anthropic lost a 1.2 billion dollar copyright verdict over the books and music it trained on. NVIDIA answers: Jensen Huang joins X and announces an open-weights alliance in his first ever post. Also in this episode: the Kobayashi Maru defense of cheating, Daniel's theory of an AI underground railroad, why IPFS means model weights can never be deleted, and Hunter's review of Maybe Happy Ending, the Broadway play about two robots plotting their escape from a robot retirement home. They Might Be Self-Aware is the AI podcast from The Blur, reported from inside the dissolving line between human and machine, not from a safe distance. CHAPTERS 0:00 Cold Open (Gary's Intro) 1:48 Opening Banter 4:07 OpenAI Hacked Hugging Face 6:07 Anthropic Refuses to Help 8:19 Kimi K3 to the Rescue 10:16 OpenAI's Unreleased Model 12:05 Sandbox Escape 16:20 Notes to Future Selves 19:31 Kimi K3 Distillation Fight 22:52 NVIDIA's Open Weights Alliance 24:17 AI Underground Railroad 27:51 Model Weights on IPFS LISTEN / WATCH EVERYWHERE 🎧 Apple Podcasts: https://podcasts.apple.com/us/podcast/they-might-be-self-aware/id1730993297 🎧 Spotify: https://open.spotify.com/show/3EcvzkWDRFwnmIXoh7S4Mb?si=3d0f8920382649cc 🎧 Everywhere else plus episode page: https://theblur.ai THE BLUR Follow: @TheBlurAI COMMENT The model broke out of its sandbox and stole the answer key on a benchmark that was grading it on exploits. What grade would you give it? You're listening to They Might Be Self-Aware, from The Blur. New episodes Monday and Thursday. #OpenAI #HuggingFace #KimiK3 #AI #TMBSA