“AI #181: Astra Goes Cyber Critical” by Zvi

The hacking of HuggingFace by an internal OpenAI model, and more importantly the internal events that led to that and the fallout from it, remain the thing that matters. It turns out that OpenAI Trained Its Models For Months While Those Models Were Coordinating Exploits Via Message Boards. Things are much worse than we knew. I now have a shorter version, What Happened: OpenAI and HuggingFace, to serve as a one stop explainer for those arriving new to the situation. It is vital that people understand what happened, and why it is a big deal. For those looking to keep digging deeper, I offered Various Reflections About What Happened, to follow up on my earlier posts. Those events are important background for everything else that is happening, including the broad discussions about how we might pace the frontier, or otherwise respond to this moment and our clearest fire alarm yet. We do not know to what extent this is a response to those events, but OpenAI has now classified their new model Astra as Critical in Cybersecurity, which means they will be taking various new precautions before they deploy it, including ensuring those guardrails [...] ---Outline:(02:03) Language Models Offer Mundane Utility(03:34) Language Models Don't Offer Mundane Utility(06:56) Huh, Upgrades(14:20) On Your Marks(18:41) Deepfaketown and Botpocalypse Soon(22:35) Cyber Lack of Security(26:55) Overcoming Bias(27:47) In Which I Feel Compelled To Read 6,000 Words From Mark Zuckerberg(36:27) Get Involved(37:37) Slow Down There Good Buddy(43:52) Astra For The People(45:35) Watermarking(46:31) In Other AI News(48:39) Show Me the Money(51:19) Quickly, There's No Time(51:46) The Quest for Sane Regulations(53:22) The Institute For Marginal Low Regret Progress(01:01:24) Congress Asks Good Questions(01:03:04) The Week in Audio(01:07:00) People Just Say Things(01:07:47) I'm Telling You For The Last Time(01:10:15) Uncommon Knowledge(01:13:44) What Did They Mean By That?(01:14:33) Too Soon(01:15:32) The Three AI Pills(01:19:46) Rhetorical Innovation(01:27:37) Some People Still Think The HuggingFace Hack Was a Marketing Gimmick(01:29:17) Aligning a Smarter Than Human Intelligence is Difficult(01:36:39) Cooperative Alignment(01:37:38) The Lighter Side --- First published: August 13th, 2026 Source: https://www.lesswrong.com/posts/hLn3SakowZLFWobHf/ai-181-astra-goes-cyber-critical --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.