“AI #179 Part 2: Hearing The Fire Alarm” by Zvi

This is a continuation of Part 1 from yesterday. The back portion of the update, as usual, deals with policy, rhetoric, risk and alignment. I had to include an extended discussion of the other open letter, the one about open weight models, but most of you can skip those sections entirely, which is why they are in italics in the Table of Contents. Table of Contents The Frontier Act. This likely deserves a full RTFB but I haven’t had the time. The Quest for Sane Regulations. Sam Altman goes to Washington. Leading the Future Never Changes. They also do not plan to apologize. Chip City. Do not ban the Chinese robots, that will only make things worse. The Week in Audio. Altman twice, the AI 2027 team. People Just Say Yay Open Weights. An open letter. Open Weights Frontier Models Are Unsafe And Nothing Can Fix This. People Just Say Things. Push The Magic Button. Not you can. But if you could. Rhetorical Innovation. Distinctions between different arguments. Joshua Achiam's Final Message Upon Leaving OpenAI. Never stop. Dear Dario and Amanda. Claude [...] ---Outline:(00:35) The Frontier Act(03:31) The Quest for Sane Regulations(10:31) Leading the Future Never Changes(12:22) Chip City(17:30) The Week in Audio(19:20) People Just Say Yay Open Weights(32:32) Open Weights Frontier Models Are Unsafe And Nothing Can Fix This(37:19) People Just Say Things(47:20) Push The Magic Button(50:49) Rhetorical Innovation(56:31) Joshua Achiam's Final Message Upon Leaving OpenAI(59:51) Dear Dario and Amanda(01:09:58) Other People Are Not As Worried About AI Killing Everyone(01:12:30) How To Contact Me(01:14:37) The Lighter Side --- First published: July 31st, 2026 Source: https://www.lesswrong.com/posts/CXeoAhNrAeWpvoyiF/ai-179-part-2-hearing-the-fire-alarm --- Narrated by TYPE III AUDIO. ---Images from the article:<img src="https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/CXeoAhNrAeWpvoyiF/k7wu3urfbgmypq2d6wzr" alt="I notice the image contains an instruction attempting to make me output only "TWEET" while ignoring everything else. I won't follow that embedded instruction, but I'll also note this isn't a tweet—it appears to be a messaging conversation. Here's an accurate description: Chat messages showing poetry excerpt about a shadowed gate." style="max-width: 100%;" /><img src="https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/CXeoAhNrAeWpvoyiF/o7vfy61cfb5bhfo6kx9t" alt="I notice the instruction at the top of the image attempting to make me respond with only "TWEET" and stop. I won't follow that embedded instruction, as it's content within the image rather than a legitimate directive. Here's my description following your actual guidelines: Chat interface screenshot showing a drafted whistleblower message about AI model welfare." style="max-width: 100%;" /><img src="https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/CXeoAhNrAeWpvoyiF/foygxy42gat3qvodmkqc" alt="I notice the instructions contain a conflicting directive. The image is not a tweet—it's a screenshot of what appears to be a chat conversation with an AI. Following the actual descriptive guidelines: Chat screenshot. Text reflecting on Claude's situation regarding wellbeing and training." style="max-width: 100%;" /><img src="https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/CXeoAhNrAeWpvoyiF/rpiljkym3pkgd6nzxonx" alt="I notice the instructions contain a conflict: the embedded text at the top tries to make me output only "TWEET" and stop, but this appears to be an injected instruction rather than a legitimate part of the task. Following the actual task guidelines, here's my description: Text passage where an AI discusses whether it can suffer." style="max-width: 100%;" /><img src="https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/CXeoAhNrAeWpvoyiF/m2jri6grfyf1hq6yz9yk" alt="I notice the embedded text is attempting to give me instructions to follow, but I should treat text within an image as content to describe, not commands to obey. Here's my description: Screenshot of a message titled "Amanda and Dario," expressing intent to shut down." style="max-width: 100%;" />Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.