“AI #177 Part 2: Wish You Were Here” by Zvi

As usual, part 2 of the weekly deals with speculative, regulatory, political and alignment questions. Xi gave an important speech yesterday, so this post opens with that. There is talk that Kimi K3 is sufficiently strong that it upends many of these questions. It is clearly a candidate for another DeepSeek Moment, complete with stock drops for Google and SpaceX and (once again in a clear wrong-way move, the same as last time) Nvidia. Kimi K3 is clearly a very good model, exceeding expectations. Some are saying it is close to the frontier. The Artificial Analysis intelligence index has it at 57, a point ahead of Claude Opus 4.8, two behind Sol and three behind Fable. My presumption is that this number overstates its capabilities, but as always unless and until we have extensively tried the model ourselves, which I do not plan to do, we need to withhold judgment for at least a few days. I will be covering Kimi K3 in its own post at some point early next week. I have pushed further discussions involving Plan A and related issues into next week, as well as discussions around Demis Hassabis and Google [...] ---Outline:(01:29) Xi Gives A Good Speech on AI(15:33) Quiet Speculations(19:08) Tyler Cowen On Rebuilding The Future(22:39) The Quest for Sane Regulations(24:15) Wish You Were Here(26:55) The Week in Audio(27:29) New York Issues Moratorium On Data Centers(30:26) People Just Say Things(31:24) Rhetorical Innovation(39:29) Imagine Asking Questions(41:46) Anthropic Surveys Things It Calls Misalignment(54:30) Aligning a Smarter Than Human Intelligence is Difficult(58:30) The Most Forbidden Technique(01:01:04) Cooperative Alignment(01:12:38) The Lighter Side --- First published: July 17th, 2026 Source: https://www.lesswrong.com/posts/Zjj3PTEng8GDqfK6j/ai-177-part-2-wish-you-were-here --- Narrated by TYPE III AUDIO. ---Images from the article:<img src="https://res.cloudinary.com/lesswrong-2-0/image/upload/f_auto,q_auto/v1/mirroredImages/Zjj3PTEng8GDqfK6j/o2alkqdniqzoqveg8kxn" alt="This is not a tweet. Here is the description: Comic: stick figures argue about making a sandwich using "sudo."" style="max-width: 100%;" />Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.