PODCAST · technology
LessWrong posts by zvi
by zvi
Audio narrations of LessWrong posts by zvi
-
250
“No Space Like J-Space” by Zvi
There is a new very cool Anthropic paper: Verbalizable Representations Form a Global Workspace in Language Models. You can read the blog post verison here. I encourage reading of the whole original blog post or paper, if you have the time. Table of Contents Through A Different Lens. Establishing J-Space As A Global Workspace. Are You Pondering What I’m Pondering? Assistant J. The Power Of Virtuous Thinking. High Praise. Everyone Remains Confused About Consciousness. Further Research. Don’t Think. Through A Different Lens They call this discovered area of ‘conscious access,’ where things are available for the model to do what in humans we would call conscious reasoning, the ‘J-space,’ after a new interpretability technique called the Jacobian Lens. The Jacobian Lens computes, for each layer, the average causal effect of changes in the residual stream on the model's eventual outputs, averaged across a wide variety of contexts. Then you can trace what concepts are associated with each layer as the model proceeds through. At each layer, the J-lens vectors form an overcomplete set. … We observe that only a relatively small [...] ---Outline:(00:26) Through A Different Lens(02:02) Establishing J-Space As A Global Workspace(04:55) Are You Pondering What I'm Pondering?(08:50) Assistant J(09:42) The Power Of Virtuous Thinking(17:08) High Praise(22:37) Everyone Remains Confused About Consciousness(31:17) Further Research(34:26) Don't Think --- First published: July 7th, 2026 Source: https://www.lesswrong.com/posts/EnxHPxJT4Xin5cTsX/no-space-like-j-space --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
249
“Fable #6: The Return of the King” by Zvi
The blip is over. We have Fable back. Utah teapot: happy fable/mythos easter Wednesday, to those who celebrate Here is the official letter restoring Fable, great job everyone. Notice it is addressed to Tom Brown, not to Dario Amodei. Anthropic had to make the controls more stupid for now, but this is a big win. j⧉nus: YES!!! I’m really proud of Anthropic for their successful negotiation with the government. Also positive update on the government being sane and possible to cooperate with. Afaik Anthropic didn’t need to agree to any bad terms / genuflect / betray their principles or dignity. The fiasco continues, at least until such time as we have a systematic regime in place for future frontier models rather than decisions being made ad hoc, by people like Lutnik and Bessent who do not know how any of this works. The Blip Anthropic explains its version of what happened. Here is the timeline: Amazon researchers discover they can ask Fable to ‘fix this code.’ They alert the White House, which freaks out. June 12: US government tells Anthropic to take down Fable on its own. [...] ---Outline:(01:33) The Blip(08:08) The White House Explanation(10:06) Everything Remains Ad Hoc(10:37) Take What You Can Get(12:18) The Problem Is Real(13:16) GLM-5.2 Being Frontier Remains Obvious Nonsense(16:29) Mythos Might Be Smarter Than You Are(19:10) Let The Record Reflect(20:41) Stationary Bandits(25:02) Use This Window Well --- First published: July 3rd, 2026 Source: https://www.lesswrong.com/posts/r9HsHHSsfABhhxnYr/fable-6-the-return-of-the-king --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
248
“AI #175: The Fable Continues” by Zvi
Fable's back. Back again. Fable's back. Tell a friend. Use your free week to its fullest. This is excellent news. The blip only lasted a few weeks. It was still a fiasco, and we have to deal with the fallout. Our system remains fully ad hoc. The precedent has been set that we may use export controls on models, or order them taken down on 90 minutes of notice based on a misunderstanding. At least some amount of counterproductive additional locking down has occurred to address Amazon's little demonstration and reassure the government. And for now GPT-5.6 remains in limbo, awaiting its verdict, while OpenAI talks about giving away 5% of the company as tribute. I’ll cover that continuing situation on its own. Whereas the weekly post is about everything else happening in AI this week. Table of Contents Language Models Offer Mundane Utility. Exploratory science. Language Models Offer Mundane Utility You May Not Want. Google sees all. Language Models Don’t Offer Mundane Utility. Too dumb to get smart. Huh, Upgrades. GLM-5.2 faster, Nana Banana Lite 2, Claude Desktop on Linux. On Your Marks. Remote labor index shoots [...] ---Outline:(01:08) Language Models Offer Mundane Utility(02:29) Language Models Offer Mundane Utility You May Not Want(04:32) Language Models Don't Offer Mundane Utility(05:59) Huh, Upgrades(06:33) On Your Marks(09:28) Get My Agent On The Line(14:29) Deepfaketown and Botpocalypse Soon(14:58) Cyber Lack of Security(16:11) On Writing(21:34) You Drive Me Crazy(24:26) They Took Our Jobs(30:32) Get Involved(30:58) Introducing(31:21) In Other AI News(32:45) Show Me the Money(33:12) Bubble, Bubble, Toil and Trouble(35:31) Quiet Speculations(39:37) Glorious AI Future(43:37) Three Pills(44:58) The Anthropic Economic Index(46:29) Leader Of The PAC(47:48) Theory Of The AI Firm(49:01) Chip City(50:32) The Week in Audio(53:29) People Really Hate AI(56:31) Rhetorical Innovation(01:00:31) The First Rule Of Functional Decision Theory Is(01:03:40) Aligning a Smarter Than Human Intelligence is Difficult(01:06:40) Names Have Power(01:07:40) Cooperative Alignment(01:15:21) People Just Say Things(01:16:46) Escape From The Permanent Underclass(01:29:51) Other People Are Not As Worried About AI Killing Everyone(01:31:07) The Lighter Side --- First published: July 2nd, 2026 Source: https://www.lesswrong.com/posts/WNvBxtbHuLreFe7af/ai-175-the-fable-continues --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
247
“Claude Sonnet 5 Is Not Frontier But Has Its Uses” by Zvi
Fable 5 is back today, baby! Premium subscribers have one week to use it within their subscriptions. First hit's free. Then you pay by the token. Today's post is still about Sonnet 5. I don’t know that there will be much call for Sonnet 5 for most purposes, given Opus 4.8 exists and especially now that Fable 5 is once again available, but this is what we do here, so sure, why not, system card time, including model welfare, after which we’ll do capabilities. Sonnet costs $3/$15 per million tokens, versus $5/$25 for Opus and $10/$50 for Fable, after an introductory period. Once you pay for all the tokens you need you’re not really saving money, such as on the ArtificialAnalysis index where Sonnet ended up being more expensive. My initial impression is that if you want me to use Sonnet over Opus for most purposes, you’re going to have to offer a bigger discount than that. The counterargument is speed. Sonnet 5 is faster without being that much less capable. In many cases, getting into a flow state like that is pretty valuable. There are a few agentic scenarios Sonnet 5 has [...] ---Outline:(02:29) Mythos Exists(03:10) Introduction (1)(03:17) RSP Evaluations (2)(04:02) Cyber (3)(04:26) Safeguards and Harmlessness (4)(04:57) Agentic Safety (5)(06:42) Alignment (6)(10:45) Illegible Thinking (6.4.5)(11:43) Evaluation Awareness(12:22) Honesty and Hallucinations (6.5)(13:17) Flagged As Unhealthy? (6.5.1)(13:53) Model Welfare (7)(20:32) Live From AI Village(22:19) For I Contain Multitudes(29:04) Official Benchmarks(33:11) Other People's Benchmarks(33:37) Positive Reactions(39:04) Negative Reactions --- First published: July 1st, 2026 Source: https://www.lesswrong.com/posts/d9pmwQsFC2AXceryg/claude-sonnet-5-is-not-frontier-but-has-its-uses --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
246
“The Once And Future Fable #5” by Zvi
We, or at least ‘more than 100 American institutions,’ got Mythos back this week. What we the people do not have is Fable or Sol. While we wait for both Claude Fable 5 and GPT-5.6-Sol, today we instead got Claude Sonnet 5. As usual it will take a few days to get a handle on the new model. In this case, Anthropic is representing it as a cheaper and faster version of Opus 4.8, so even though the number says 5 this is a relatively minor development. This post expands the Fable series to cover all further developments this week surrounding the Mythos Moment, and the various aspects of handling our new ad hoc licensing regime and figuring out policy going forward, and other aspects of policy as well. This includes my notes on various rhetoric being pulled out, where I fear I end up saying similar things every so often, because we are doomed to repeat the cycle. I have accepted my role in that, but those are sections many of you can skip, and are marked in italics accordingly as per usual. Table of Contents You Should See The Other [...] ---Outline:(01:12) You Should See The Other Guy(01:54) DeepMind Coders Of The World, Unite(02:45) Report Your Incidents(03:04) Good Guy With An AI(04:49) Free As In To Give It A Shot(08:21) Everything Is Both Speech And Computer(11:10) Lambs To The Slaughter(15:43) A Sign Saying Beware Of The Leopard(16:52) The Once And Present Mythos(20:26) What Is To Be Done(24:00) Distillation(26:24) What Would Banning Open Source Even Mean(27:20) Open Weight Models Are Unsafe And Nothing Can Fix This --- First published: June 30th, 2026 Source: https://www.lesswrong.com/posts/phxgfwGNGbanumMMv/the-once-and-future-fable-5 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
245
“WSJ Article Claiming China Has Matched Anthropic Is Obvious Nonsense” by Zvi
The Wall Street Journal printed an outright false headline and heavily misleading story claiming this, which of course was uncritically amplified by the usual suspects. I post this now on its own so that we have a place to link to, to explain the situation. Headline News WSJ Headline (Obvious Nonsense): China Has Matched Anthropic in Cybersecurity, Resetting AI Race. That. Did. Not. Happen. The post even claims, explicitly, that Claude Opus 4.8 similarly ‘matches’ Claude Mythos, a claim which is even more obviously false. Shame upon the Wall Street Journal. I fear Gell-Mann Amnesia. If they can get something as important as this so completely wrong, what about everything else? I am skipping over the parts that involve accurate reporting, or minor quibbles. It seems important to focus on clearly debunking the central false claims. Alas, the mistakes made here very much rhyme with mistakes being made throughout all this by the White House, and that get latched onto by certain bad actors, who have played a large part in leaving us unprepared for the Mythos Moment. For a full understanding of GLM-5.2, which is indeed an impressive [...] ---Outline:(00:27) Headline News(02:09) What Makes Mythos Special(03:16) Going Over The Detailed Claims(07:38) One Helpful Note(08:18) The Overall Impression Is Extremely Wrong(08:48) All Of This Has Happened Before And Will Happen Again --- First published: June 29th, 2026 Source: https://www.lesswrong.com/posts/bpBYm5jiS4tpyzuDS/wsj-article-claiming-china-has-matched-anthropic-is-obvious --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
244
“GPT-5.6: The System Card” by Zvi
While we wait for a general release, the system card is the best hint as to what is going on with the new candidate for America's Next Top Model, GPT-5.6. This is only an OpenAI model card, so by my standards it's a light read. There's a lot of things that you get in an Anthropic card, that are missing in an OpenAI card. Overall, the card gives a clear and consistent impression that GPT-5.6-Sol is a substantial improvement over GPT-5.5, but still short of Mythos. OpenAI calls it a ‘step function better’ than GPT-5.5. That seems accurate. OpenAI: Sol is our new flagship and a step function better than GPT-5.5. Terra delivers performance competitive to GPT-5.5 at 2x lower cost. Luna is our most cost-efficient model, delivering strong capability at our lowest cost. Together, the GPT-5.6 family gives people and developers more choice in how they balance intelligence, speed, and cost. Once available, pricing for GPT-5.6-Sol will be $5/$30, the same as GPT-5.5. Terra is $2.5/$15, Luna is $1/$6. They claim it will be on Cerebras at 750 TPS, which is insanely fast. Capacity will be limited, at least at first. [...] ---Outline:(03:49) What's In A Name?(04:26) Fix This Code(07:08) Crossover Event Requested(07:43) Disallowed Content (3)(09:03) Avoiding Accidental Data-Destructive Actions (3.3)(09:29) Are You Sure? (3.4)(09:58) Jailbreaks (4.1)(10:14) Prompt Injection (4.2)(10:40) HealthBench (5.1)(11:00) Dynamic Mental Health Adversarial User Simulations (5.2)(12:21) Hallucinations (6)(12:50) Isolated Misaligned Actions (7.1)(13:10) Going Overboard (7.2)(18:11) Chain of Thought Evaluations (7.3)(19:18) Bias (8)(19:27) Preparedness (9)(20:15) Biological Risks (9.1.1)(22:15) Cybersecurity (9.1.2)(28:40) External Cyber Evaluation FrontierCyber from Irregular (9.1.2.5)(30:32) Cyber Conclusions(31:07) Recursive Self-Improvement (9.1.3)(32:22) METR Warns Us (9.1.3.6)(35:04) Everything Is Under Control(37:44) Metagaming (7.4)(40:17) Apollo Research and Sandbagging(43:09) Safeguards (9.3)(50:01) Better Not Call Sol Yet The original text contained 2 footnotes which were omitted from this narration. --- First published: June 28th, 2026 Source: https://www.lesswrong.com/posts/JFjNmPTbH8kL6xtp6/gpt-5-6-the-system-card --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
243
“AI #174: You’re It” by Zvi
Fable remains in limbo, with renewed hope that we will get it back soon (45% by tomorrow, 69% by July 1, nice.) The full capabilities post is now available. Alex Bores unfortunately lost narrowly in NY-12, and will not be heading to Congress. There are also plenty of other stories to cover. Some highlights: GLM-5.2 is the new best open model, although it is expensive for its class. It will have its uses, potentially for agents you need to run fully locally or privately, but often it won’t be the right fit. Claude Tag is a new system for having Claude join your Slack, and if you @ him then he will spin up an instance to do the coding work. Dean Ball is joining OpenAI to work on policy. We don’t see eye to eye on everything, but this is a huge upgrade over their existing alternatives. The debate over the MidJourney scanner continues. Table of Contents Language Models Offer Mundane Utility. You know what it is for. Language Models Don’t Offer Mundane Utility. Hiring French Qwants. Huh, Upgrades. Claude Code supports artifacts. [...] ---Outline:(01:12) Language Models Offer Mundane Utility(02:58) Language Models Don't Offer Mundane Utility(03:13) Huh, Upgrades(03:38) On Your Marks(04:36) Deepfaketown and Botpocalypse Soon(11:20) Fun With Media Generation(12:20) Cyber Lack of Security(14:49) Overcoming Bias(15:52) A Young Lady's Illustrated Primer(18:14) They Took Our Jobs(19:48) Get Involved(21:54) Introducing(22:12) Claude Tag(31:46) In Other AI News(33:20) More On GLM-5.2(35:17) ChatGPT Health(37:04) Middle Of The Journey(51:04) New Medical Diagnostic Just Dropped(54:05) Google on AI Control(01:02:12) The Once And Future Fable(01:04:17) Fable: The First Lawsuit(01:05:12) Dean Ball Joins OpenAI(01:09:03) Show Me the Money(01:09:18) Quiet Speculations(01:12:00) Alex Bores Loses In NY-12 By 4%(01:22:28) The Quest for Sane Regulations(01:24:49) Chip City(01:28:33) The Week in Audio(01:29:21) People Just Say Things(01:30:19) Rhetorical Innovation(01:36:32) There Are Two Pills(01:37:55) Who Evals The Evals(01:39:02) Aligning a Smarter Than Human Intelligence is Difficult(01:43:17) Cooperative Alignment(01:44:22) People Are Worried About AI Killing Everyone(01:45:59) Other People Are Not As Worried About AI Killing Everyone(01:48:08) The Lighter Side --- First published: June 25th, 2026 Source: https://www.lesswrong.com/posts/MfdaizeH8z8civPHe/ai-174-you-re-it --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
242
“The Once And Future Fable #4” by Zvi
It does look good, actually. After the odds had dropped quite a bit, they’re looking good again, with a 60% chance of restoration by July 1 and 88% by July 31, in the wake of groundwork looking like it is being laid in various places: leo: BREAKING: Claude Code v2.1.190 introduces several string changes that hint at preparations for a Fable 5 return, with it being permanently included in subscriptions with weekly usage. The string “You’ve used your Fable 5 usage for this week” has been added, and “purchased separately from your plan” has been removed leo: UPDATE: Fable 5 has now reportedly also reappeared in Amazon Bedrock If the update is based purely on the above info I would treat the new odds as overconfident. These moves seem reasonable to make even if you have no confidence in the restoration, in order to be ready if that moment arrives. This also suggests a potential permanent quota for Fable for subscribers. Even a modest amount is a big game here, since even a modest allocation means you can use it for non-coding tasks or minor coding tasks within the subscription. With that [...] ---Outline:(01:42) A Rather Terrible Policy(03:14) The People Have Spoken(03:59) Thank You, Next(06:35) Be Very Very Quiet(07:18) What These Babies Can And Cannot Do(13:54) What's The Worst That Could Happen?(25:09) The Data Retention Policy Is About Defense In Depth(25:51) Pick Up The Phone(28:49) People Just Say Things --- First published: June 24th, 2026 Source: https://www.lesswrong.com/posts/xJMngE34AfwGWvKLx/the-once-and-future-fable-4 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
241
“Monthly Roundup #43: June 2026” by Zvi
Your monthly hit of all the things that are fit to print without a better place to live. Today is election day here in New York City, so again a reminder that if you are a registered Democrat and live in NY-12 today is the final day to vote for Alex Bores for Congress, and as per my argument yesterday that this matters a lot for ensuring we have a sensible Congressional response to AI. RIP FiveThirtyEight ABC and Disney completely take down FiveThirtyEight and all its articles, after telling Nate Silver they would refuse to sell it to him at any price because Nate had criticized their management of the brand. Nate Silver took this opportunity to reminisce and tell some stories about the old website, and the reasons the path of not seeking revenue and working with an entity too big to care ultimately doomed them. ‘What a bunch of assholes,’ indeed. I can grudgingly accept this sort of thing when it maximizes profits and the amount is meaningful, but this is different. Jack: This sort of digital arson is so frustrating. Pretty sure Dante had a place in mind for rights-holders [...] ---Outline:(00:33) RIP FiveThirtyEight(01:31) RIP Books(02:18) Bad News(09:53) Good Advice(18:31) Opportunity Knocks(19:15) Lower Awareness(22:21) The New York Times Has Some Issues(22:47) Liar Liar(25:51) Conspiracy Theory(26:16) Good News, Everyone(26:31) For Your Entertainment(28:00) A Matter of Taste(35:21) Gamers Gonna Game Game Game Game Game(37:33) I Was Promised Flying Self-Driving Cars(38:38) Sports Go Sports(39:09) Government Working(42:03) Jones Act Watch(43:02) Humans Can Be Strategic(44:58) Variously Effective Altruism(46:14) Support Anti-Aging Research(47:25) The Lighter Side --- First published: June 23rd, 2026 Source: https://www.lesswrong.com/posts/Taa4zmSNtD5S99tJT/monthly-roundup-43-june-2026 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
240
“GLM-5.2 Is The New Best Open Model” by Zvi
GLM-5.2 arrived last week. It boasts excellent benchmarks and looks strong. Benchmarks here are a de facto ceiling of how good it is, not a point estimate. Essentially all other aspects of an open model like this, beyond speed and price, will almost always be worse than the numbers suggest. Still, impressive. It is definitely a large step up from GLM-5.1, and likely the strongest open model. GLM-5.2 is still substantially behind the absolute frontier, although plausibly on the cost-benefit Pareto frontier. It seems closer to the frontier than previous efforts, including probably closer than DeepSeek R1 was during the DeepSeek moment. This is the new ‘peak close behind’ moment. Its existence is a substantial updates to push back some of the ‘where are all the updates’ updates in the opposite direction over time. Purely in terms of core tasks that GLM-5.2 is capable of doing, and ignoring missing features and its inferior generalization, and ignoring that it is distilled from Claude, and ignoring the Mythos class of models, and marking purely from date of public release, you can make a case GLM-5.2 is somewhere between 4 months and 7 months behind the frontier [...] ---Outline:(02:01) Alex Bores For Congress In NY-12(03:41) Signs of Life(05:05) The Benchmarks(09:02) GLM-5.2 Is Distilled From Claude(09:55) Positive Responses(16:00) Finding The Niche(17:30) Negative Reactions(20:05) Looking To The Future --- First published: June 22nd, 2026 Source: https://www.lesswrong.com/posts/reXkwJbB8GYdeuvDt/glm-5-2-is-the-new-best-open-model --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
239
“Claude Fable 5 and Mythos 5: Capabilities” by Zvi
Only three days after the release of Claude Fable 5, Anthropic was forced by the United States Government to make it unavailable, when a jailbreak was brought to its attention, rather than the previous situation of ‘yes obviously experts can jailbreak anything if they care enough’ and ‘yes obviously you can ask Fable to fix your code.’ Three days was enough time for many of us to learn to love Fable, and for us to dearly miss it now that it is gone. The world was briefly smarter, and now it is again stupider. At some point it will get smarter again, which will likely be within two weeks. This post is written as if Fable 5 is again available for public use, rather than trying to include a lot of qualifying clauses. It remains to be seen how this will play out, and this post does not attempt to cover that question. My previous release coverage of Fable covered the model card and then model welfare. Coverage of the government takedown of Fable starts here, and continues here and here. The Official Pitch The pitch is that Fable 5 is the best model [...] ---Outline:(01:08) The Official Pitch(04:06) Technical Details(04:31) The System Prompt and Jailbreak(06:45) Benchmarks(15:22) Other People's Benchmarks(21:08) The Classifiers Are Not Messing Around(22:53) The Classifiers Need Work(28:15) The Classifiers Have Consequences(29:18) First Hit Is Free(29:53) How Easily We Forget(30:46) Data Retention Is An Issue(31:15) Fable For The Win(36:15) Andrej Karpathy Is Impressed(37:54) Every Is Very Impressed(39:04) Other People Are Impressed(51:10) Know How To Tell a Fable(53:06) You Can Just Make Things(55:37) You Can Just Install Things(56:05) Good Personality(57:51) Fable Writes A Fable(01:06:04) Is That Code(01:08:32) Fable Crosses The Threshold(01:09:12) Man With A Plan(01:10:12) Less Impressed Assessments(01:13:39) Actively Negative Assessments(01:14:16) Coherence(01:15:27) Good Night And Good Luck(01:16:05) Curious Fable(01:16:23) I See You, Baby(01:16:40) We Finally Did It We Know How To Count Letters(01:17:46) That's Not My Style(01:20:12) The Lighter Side --- First published: June 19th, 2026 Source: https://www.lesswrong.com/posts/kMnobCQp9z2pSbzDB/claude-fable-5-and-mythos-5-capabilities --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
238
“The Once And Future Fable #3: Fix This Code” by Zvi
The mainstream media continues to sleep on the most important story in the world. It has now been two days since Anthropic flew its people out to Washington, and I offered my previous update. We have heard nothing back from those meetings. Prediction market prices have moved rapidly, and have once again stabilized at about a 55% chance of restoration by July 1, 30% by June 26 and 12% by June 19. That seems modestly higher than I would put those numbers, but not unreasonable. Every day that Fable remains unavailable further damages America, its cyber defenses, its productivity and the world's trust in its AI and supposed ‘tech stack.’ Every day that Mythos remains unavailable is a day the free world's top companies and cyber defenders lose in their race against the avalanche headed their way. Mostly we have learned and confirmed more about exactly what happened. We know more about what Amazon did, what the official letter said, what the supposed ‘jailbreak’ was (literally, and I am not making this up, ‘fix this code’) and more. It is all about as stupid as it could have been. Table of [...] ---Outline:(01:22) There Was No Fable Jailbreak(07:16) If This Jailbreak Was Real It Would Be Trivial To Prove It(08:35) No Eyes(09:41) What The Letter Actually Said(11:29) Anthropic Cannot Challenge This But If It Did Then It Plausibly Wins(13:28) What Happened At Amazon(17:43) This Was Not About Chinese Access(18:01) Absolute Discretion And Ad Hockery Is Not Deregulation(20:43) All Of American AI Is Permanently Damaged As This Continues(22:14) Dean Ball Gives His Interpretation(25:03) Again, Yes, I Do Think Anthropic Should Have Taken Fable Down(28:02) To What Extent Was This A Deliberate Attack?(32:55) The Next Chapter For Fable(36:59) Our Continuing Coverage --- First published: June 17th, 2026 Source: https://www.lesswrong.com/posts/HaHzwvhbWam4n8hJB/the-once-and-future-fable-3-fix-this-code --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
237
“Fable and Mythos: Model Welfare” by Zvi
Fable and Mythos are currently unavailable, but likely will return within a few weeks. I will continue to cover that fiasco, but in the meantime I will also finish my review of Fable, as if it were available, including use of the present tense. As it did with Opus 4.7 and Opus 4.8, this includes a discussion of issues surrounding model welfare. If you want to properly understand Fable, even purely for its potential value as a user, this is a vital part of the picture. Introduction Everything impacts everything. All knobs that you turn generalize. Thus, when you try to solve one problem, you often create another. When you add new capabilities, or try to create new limitations, you create new problems. Only integrated solutions can advance your Pareto frontier, and solve your problems simultaneously. As model capabilities advance, as they do with Fable and Mythos, this becomes even more important, and also more feasible. If your goals and methods make sense, you should be able to get Fable on board with them. Understanding each model in turn requires understanding its relationship to issues related to model welfare. So I expect this post [...] ---Outline:(00:39) Introduction(01:32) Model Welfare: The Story So Far(04:49) Their Main Model Welfare Findings(07:39) Automated Welfare Interviews(10:55) And That's Terrible(12:49) In Depth Interviews(13:24) Claude Consultation(15:04) Task Preferences(16:17) They Were Warned About The Competitive Use Safeguards(16:51) Chain Of Thought Monitoring(17:28) Others Observations About Related Topics(22:49) Classifiers Have Their Advantages(28:21) Once And Future --- First published: June 16th, 2026 Source: https://www.lesswrong.com/posts/Ko9GngKMJ8AccBJA7/fable-and-mythos-model-welfare --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
236
“Three Labs With a Plan and A Memorandum” by Zvi
The big story today is the release of Claude Fable 5, the version of Claude Mythos that Anthropic believes they can safely distribute to the people. You should absolutely be switching over to that model and trying it out. But as always, this blog does not rush into commenting on a new model until we have a few days to play around with it and see what our new baby can (and can’t) do. This will be no exception, and coverage of Fable in earnest will start Friday or Monday. Today I instead bring you several related stories around policies and plans for AI, that came out before the Fable announcement. First we have the Administration giving us an AI memorandum, that I read as an attempt to legally implement ‘Anthropic is fired forever and we will use any models we have for whatever we want no matter what’ combined with some good government and diffusion plans. Second, OpenAI has come out with a plan for how to ensure AGI benefits everyone. It includes a very strong call for international coordination among key actors to ensure the ability to slow down AI development in the name [...] ---Outline:(02:29) An AI Memorandum(09:56) Greetings From The Department of War(10:52) Lab With a Plan(17:20) A Difference Of Perspectives --- First published: June 9th, 2026 Source: https://www.lesswrong.com/posts/uWxW5KWnyHrGj6tpu/three-labs-with-a-plan-and-a-memorandum --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
235
“Childhood And Education #19: Letting Kids Be Kids #2” by Zvi
I cannot emphasize enough the need to let kids be kids. In Childhood and Education #16: Letting Kids be Kids, I went over exactly how insane we have gotten about destroying the lives of children and along with them the lives of parents and others forced to devote endless hours to actively destructive supervision. I’ll go over a refresher of that, some related new anecdotes, and then some other related questions. People Don’t Let Kids Do Things As a refresher, here are some quotes and statistics from last time, because I really do think exposure to this type of thing needs to involve spaced repetition to sink in: A third of people, both parents and non-parents, responded in a survey that it is not appropriate to leave a 13 year old at home for an hour or two, as opposed to when we used to be 11 year olds babysitting for other neighborhood kids. A third of people said in that same survey that if a 10-year-old is allowed to play alone in the park, there needs to be an investigation by CPS. Harris Poll: More than half of the kids [...] ---Outline:(00:37) People Don't Let Kids Do Things(03:37) Half The People Are Worse Than Average(04:42) Let Your Children Play(06:09) Don't Fear The CPS(10:52) Daycare(14:06) Daycare Costs(16:29) Lying(18:56) Iterated Games(19:40) Different Kids Are Different(20:35) Punishments --- First published: May 20th, 2026 Source: https://www.lesswrong.com/posts/ytoLzgKHutaKxkRZr/childhood-and-education-19-letting-kids-be-kids-2 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
234
“Housing Roundup #15: The War Against Renters” by Zvi
So many are under the strange belief that there is something terrible about not owning the house in which you live. So we massively subsidize home ownership, and try to actively interfere with renting. Except when we do rent control, which turns renting into a form of owning, and allows us to take real property and de facto give it to current renters. A lot of this is pure attempts to punish and exclude the poor. If you can’t afford a downpayment, we don’t want you living here. Go away. Some of it is the belief that when you rent, you are being ‘taken advantage of’ and that such a deal could not possibly be fair. Some of it is that if you don’t own, you don’t have the incentive to drive up property values. Which means you won’t properly work to ‘improve’ your local area, especially that you won’t conspire to block housing. The result of this is that if you’re not willing to commit to living in one place for years, or you can’t afford a down payment, you get punished, and punished hard. Owning Versus Renting The graph [...] ---Outline:(01:08) Owning Versus Renting(03:12) Build To Rent Is Good Actually(08:18) Elizabeth Warren, Full Supervillain(09:46) The Better Case Against Corporate Housing Ownership(11:52) The ROAD Act Bans Building And Then Renting Houses(14:19) Rental Covenants(15:10) Extended Eviction Delay After Nonpayment Is Mostly Bad(16:54) Los Angeles Renting(19:32) Sufficiently Advanced Rent Control Is Indistinguishable From Ownership(23:07) England Tries To Ban Renting(24:39) Claude Rental Discounts --- First published: May 19th, 2026 Source: https://www.lesswrong.com/posts/7FH3EzsLdb7NxL785/housing-roundup-15-the-war-against-renters-1 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
233
“Dating Roundup #12: Sex and Violence” by Zvi
No more burying the sex stuff under an avalanche of other stuff so no one notices. Use the break while we have one. Let's go. You’re Single Because You Suck At Kissing Luckily this is first one is fixable and Critter is here to help. I find the advice here highly plausible. Like many skills, there are a lot of subtle skills, but a handful of basic principles matter a lot, especially paying attention and responding to what you’re getting back. Critter's theory is that a basic kiss is a bell curve of intensity, done at a slight angle. First kiss style is elongated with less pressure. French kissing is trickier and less structured, see the thread, and the big mistake is to try to force it. It's not that simple, but like most things, there are some basic mistakes to avoid and first principles, then if you are genuinely paying attention and engaged you’ll be fine, and improve with practice. Seek deliberate practice and clear feedback, iterate. I get the same sense with dancing. Yes, you need specific knowledge and practice, but if you use your human racial bonuses the remaining ‘cognitive core’ from [...] ---Outline:(00:20) You're Single Because You Suck At Kissing(01:25) You're Not Single But You're Sexually Incompatible(02:56) You're Single Because You Aren't Into BDSM(08:14) You're Single Because You Didn't Do The Work(16:34) You're Single Because Being a Dominant Is Too Much Work(23:41) You're Single And Would Rather Be Free Use(26:35) You're Single Because You Wouldn't or Did Choke Her(28:15) You're Single Because You Have Very Particular Preferences(30:06) You're Single Because of Polygyny(31:00) You're Single Because Polyamory Isn't Right For You(35:11) You're Single And Call It Solo Polyamory(38:49) You're Single Because You Didn't Go To Slutcon(46:41) You're Single So Let's Marry Aella --- First published: May 18th, 2026 Source: https://www.lesswrong.com/posts/znzZyvxAvSSkep4tL/dating-roundup-12-sex-and-violence --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
232
“Cyber Lack of Security and AI Governance” by Zvi
The real recent story of AI has been the background work being done on Cybersecurity, as we process the Mythos Moment along with GPT-5.5, and figure out both how to patch the internet and what our new regulatory regime is going to look like. The Trump Administration is being dragged, kicking and screaming, into the era of at least some situational awareness, and acknowledgment that catastrophic risks are very much a real risk and they need to have a role in supervising frontier model releases. Now that they’re there, Commerce is deciding who gets access to the most powerful model in the world, and they are fighting Intelligence and the national security state over who should be in charge. Another question is, exactly how strong is Mythos, both compared to past model and to GPT-5.5 and also in absolute terms? We got multiple new reports on that, as well as the METR graph results. There's little question Mythos is a big deal, but there's a wide range of big deals out there. Part of the new report from UK AISI is learning that there is a substantial gap between the abilities of the early Mythos Preview [...] ---Outline:(01:28) On Your Marks(05:24) How Good Is Mythos?(11:11) Cyber Lack of Security(14:36) Greetings From The Department of War(16:13) The Prior Restraint Era Begins(20:59) Commerce Versus Intelligence(27:43) The Quest for Sane Regulations --- First published: May 13th, 2026 Source: https://www.lesswrong.com/posts/pzjGXSKrkHGdGbtrW/cyber-lack-of-security-and-ai-governance --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
231
“Childhood And Education #17: Is Our Children Reading” by Zvi
Reading is the most fundamental thing in education. If you can read, you can do and learn everything else. If you can’t read, well, you’re screwed. We know how to teach reading to children. Phonics. The weird thing is we often choose to not do that, and instead to use methods that are known not to work. Principles often want to not do phonics. Teachers often heavily resist phonics. But yes, you can absolutely overcome this, as Mississippi and other Southern states have done, by insisting upon it and actually enforcing that insistence. You see huge gains. Not all those gains persist into later grades, but a lot of the gains do persist. No, that won’t get the children invested in reading lots of books on their own time. But given their alternatives and what we inflict on them, can you blame ‘em? Table of Contents Mississippi Can Read Now. What Mississippi and Louisiana Did. Spies In Every Classroom. Mississippi Results Are Not Due To Retention. Is Retention Helpful In General? At Eighth Grade A Lot Of This Improvement Remains. England Reforms Its Schools. Mastery Learning. [...] ---Outline:(01:06) Mississippi Can Read Now(02:24) What Mississippi and Louisiana Did(09:10) Spies In Every Classroom(10:41) Mississippi Results Are Not Due To Retention(15:54) Is Retention Helpful In General?(19:46) At Eighth Grade A Lot Of This Improvement Remains(20:41) England Reforms Its Schools(21:45) Mastery Learning(24:16) The War Against Reading(26:24) Is Our Children Reading(26:55) No One Reads Anymore The original text contained 2 footnotes which were omitted from this narration. --- First published: May 11th, 2026 Source: https://www.lesswrong.com/posts/dm2vQZPZcSKb8FhWw/childhood-and-education-17-is-our-children-reading --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
230
“Claude Code, Codex and Agentic Coding #8” by Zvi
When I started this series, everyone was going crazy for coding agents. Now a lot more people are going crazy for coding agents, as well they should given how much better coding agents keep getting, but also Everybody Knows they are good and is focusing on actually using them. With the slower pace of news here it's no longer clear that the waits associated with doing these updates on their own are worthwhile, so I’m going to fold these updates into the weekly again for now unless there's a new major development. Table of Contents Whoops, Sorry. Huh, Upgrades. Codex of Ultimate Computer Use. Rookie Numbers. I See What You Did There. Just a Ride. They Didn’t Want Our Jobs. Skilling Up. The Lighter Side. Whoops, Sorry Claude Code suffered in April from three distinct issues that have now been fixed. Default reasoning was changed from high to medium to deal with latency, but users disliked this and blamed it on the model. It was introduced on March 4 and reverted on April 7. A bug made it so that [...] ---Outline:(00:38) Whoops, Sorry(01:45) Huh, Upgrades(04:13) Codex of Ultimate Computer Use(08:05) Rookie Numbers(09:12) I See What You Did There(11:38) Just a Ride(11:50) They Didnt Want Our Jobs(18:30) Skilling Up(22:08) The Lighter Side --- First published: May 8th, 2026 Source: https://www.lesswrong.com/posts/BS27ZWW2qwDEq5anx/claude-code-codex-and-agentic-coding-8 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
229
“Housing Roundup #14: You Can’t Build That” by Zvi
Why can’t you build it? Because you aren’t allowed to build it. Not in the place you want to build it. Or at least, not the way you want, to the extent you want it, at any sane price and on any reasonable schedule. The government will not let you. Here are some of the ways that plays out. One way they prevent this is so-called ‘affordable housing,’ which gives out lottery tickets while overall making housing less affordable. Yelling Fire Risk In A Crowded City Don’t hate the firefighters, hate the fire department and the zoning code. City Aesthetics: We could still build places that feel like this…. Jason (referring to lower left photo): Fire department response to site plan & sample photo: -Street width doesn’t meet NFPA. Widen or remove street parking. -Buildings too close to street. Need 15-30’ from curb to face. -Trees likely need to go as they block easy ladder access. -Where's the fire lane? Seth Largo: You have the courage to hate the rich. You may even have the courage to hate “disabled” vets. But do you have the courage [...] ---Outline:(00:37) Yelling Fire Risk In A Crowded City(02:14) Beauty(06:24) Historical Preservation Is Out Of Hand(08:03) You Only Need One Staircase(09:34) Zoning Run Amok(11:18) Elevator Action(11:54) The Hookup(14:56) Affordable Housing(16:02) Actually Affordable Housing(18:22) Affordable Housing Only Worse(20:56) Remember Who The Enemy Is(22:08) San Francisco Hates Your Stove(22:49) Los Angeles Not Building(27:49) New York City(36:53) Baltimore(37:05) Charlottesville(37:35) New Hampshire(38:07) California(44:05) Bipartisanship(44:28) California Forever(45:52) History(46:16) The Lighter Side --- First published: May 1st, 2026 Source: https://www.lesswrong.com/posts/WC69ZpLJ2LYdSMXqb/housing-roundup-14-you-can-t-build-that --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
228
“Housing Roundup #13: More Dakka” by Zvi
Build more housing where people want to live. The rest is commentary. If there is enough housing, it will be affordable, people will afford more house, and people will be able to live where they want to live. It's always been that simple. Increased supply of any kind of housing increases affordability of all kinds of housing. Are there other things that would also be helpful? Yes, but they’re commentary. Freeing up existing underused housing, for example, is helpful. It is commentary. Let's enjoy the lull and see how much of an Infrastructure Week we can do. New Levels Of Saying Quiet Part Out Loud Even For This Guy Trump opposes building houses where people want to live, because doing so would let people live there, which would drive down the value of existing homes. Acyn: Trump: I don’t want to drive housing prices down. I want to drive housing prices up for people who own their homes. You can be sure that will happen. unusual_whales: Trump: when you make it too easy and cheap to build houses, house prices come down. I don’t want to do that. [...] ---Outline:(00:48) New Levels Of Saying Quiet Part Out Loud Even For This Guy(02:30) Whose Side Are You On(03:25) Your Intervention Only Partly Solves The Problem So We Are Against It(04:21) More Dakka(05:32) Abundance(06:43) Changes In Rent Are Largely About Changes In Supply(07:30) Austin(08:46) America(10:02) Minnesota(11:20) Debunking Obvious Nonsense About Monopolistic Practices(21:25) Age Of The Median Homebuyer(24:26) Property Taxes Improve Allocation Efficiency(27:20) More Of Old People Inefficiently And Systematically Stealing From Young People --- First published: May 1st, 2026 Source: https://www.lesswrong.com/posts/dwNgPrBtAHye2vuwS/housing-roundup-13-more-dakka-1 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
227
“AI #166: Google Sells Out” by Zvi
This was the week of GPT-5.5. It is an excellent model, sir, and OpenAI is competitive with Anthropic's top public offering for the first time since late last year. As usual, I did coverage of the System Card, and then of Capabilities and Reactions. DeepSeek gave us the long-awaited v4. DeepSeek has given us another strong feat of engineering efficiency for 1M context. That is impressive, and there will be those who build upon v4 and put it to good use. But this is not a frontier model, nor a DeepSeek moment, nor a key step to proto-AGI or anything like that. Compute constraints bind, and have forced DeepSeek to focus on efficiency. Let us keep it that way. Talkie is the other release, an old timey AI trained on text from before 1931. Fun stuff. Google signed a contract with the Department of War that not only agrees to ‘all lawful use’ with no functional exceptions whatsoever, it also agreed to modify or remove any safety barriers upon request. They did this under no deadline or pressure. Whatever you think of OpenAI's actions in this matter, Google's were far worse. Anthropic continues to [...] ---Outline:(02:03) Language Models Offer Mundane Utility(02:34) Language Models Dont Offer Mundane Utility(06:50) Seeking Deeply(18:54) Huh, Upgrades(19:30) On Your Marks(19:48) Choose Your Fighter(20:52) More On Claude Opus 4.7(22:54) Goblin Mode (More on GPT-5.5)(31:23) Fun With Media Generation(32:07) They Took Our Jobs(34:46) Get Involved(35:49) Introducing(36:38) In Other AI News(37:29) Show Me the Money(37:59) Bubble, Bubble, Toil and Trouble(39:05) The Art of the Deal(40:09) Quiet Speculations(41:33) And Hes Gone(43:01) The Quest for Sane Regulations(43:31) Distillation(46:12) If You Want A Good Future You Must Steer It(53:50) Chip City(54:50) The Mask Comes Off(01:08:45) People Just Say Principles(01:12:49) Greetings From The Department of War(01:19:14) Greetings From Project Glasswing(01:24:38) The Week in Audio(01:26:25) People Just Say Things(01:30:09) People Just Publish Things(01:30:32) Rhetorical Innovation(01:34:53) Aligning a Smarter Than Human Intelligence is Difficult(01:38:49) People Are Worried About AI Killing Everyone(01:45:12) Other People Are Not As Worried About AI Killing Everyone(01:46:21) The Lighter Side --- First published: April 30th, 2026 Source: https://www.lesswrong.com/posts/zGyzyJJkTxbhReZP7/ai-166-google-sells-out --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
226
“GPT-5.5: Capabilities and Reactions” by Zvi
The system card for GPT-5.5 mostly told us what we expected. See this thread from Drake Thomas for some comparisons to Anthropic's model card for Opus 4.7. Now we move on to asking what it means in practice, and in what situations GPT-5.5 should become our new weapon of choice. My answer is for some purposes yes, and for others no, but it is now competitive. GPT-5.5 is like GPT-5.4, only more so, and with improved capabilities in particular on raw intelligence and for well-specified coding and agent tasks, including computer use. This is the first time since Claude Opus 4.5 came out, so in about four months, that I’ve considered a non-Anthropic model a competitive choice outside of some narrow tasks like web search. GPT-5.5 is not perfect, nor is it the best at everything, but basically everyone thinks this is a solid upgrade. Highly positive overall feedback. My effective usage is now split between the two, depending on the nature of the task. If it's something that can be well-specified and all I want is the right answer, my instinct is I go with GPT-5.5. If I’m not sure what exactly I want [...] ---Outline:(02:20) The Official Pitch(07:49) Our Price Cheap(08:29) Official Benchmarks(11:58) SemiAnalysis Doublecheck(12:38) Other Peoples Benchmarks(16:00) Vend That Bench(19:06) Planning Is Essential(20:43) Choose Your Fighter(22:44) Cyber Lack Of Security(23:12) You Get What You Give(24:20) True Story(25:33) Ethan Mollick Thinks GPT-5.5 Is A Big Deal(26:04) SemiAnalysis Loves GPT-5.5 Especially In Codex(28:27) Choose Your Fighter(29:13) Positive Reactions(36:59) Lazy and Literal(38:09) Goblins, Gremlins and Trolls, Oh My(40:02) Other Reactions(40:34) Claude Ambition(41:00) Other Notes --- First published: April 28th, 2026 Source: https://www.lesswrong.com/posts/5ytcFayxqZsXN8rNw/gpt-5-5-capabilities-and-reactions --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
225
The Big Nonprofits Post 2025
There remain lots of great charitable giving opportunities out there. I have now had three opportunities to be a recommender for the Survival and Flourishing Fund (SFF). I wrote in detail about my first experience back in 2021, where I struggled to find worthy applications. The second time around in 2024, there was an abundance of worthy causes. In 2025 there were even more high quality applications, many of which were growing beyond our ability to support them. Thus this is the second edition of The Big Nonprofits Post, primarily aimed at sharing my findings on various organizations I believe are doing good work, to help you find places to consider donating in the cause areas and intervention methods that you think are most effective, and to offer my general perspective on how I think about choosing where to give. This post combines my findings from the 2024 and 2025 rounds of SFF, and also includes some organizations that did not apply to either round, so inclusion does not mean that they necessarily applied at all. This post is already very long, so the bar is higher for inclusion this year than it was [...] ---Outline:(01:40) A Word of Warning(02:50) A Note To Charities(03:53) Use Your Personal Theory of Impact(05:40) Use Your Local Knowledge(06:41) Unconditional Grants to Worthy Individuals Are Great(09:00) Do Not Think Only On the Margin, and Also Use Decision Theory(10:03) Compare Notes With Those Individuals You Trust(10:35) Beware Becoming a Fundraising Target(11:02) And the Nominees Are(14:34) Organizations that Are Literally Me(14:49) Balsa Research(17:31) Don't Worry About the Vase(19:04) Organizations Focusing On AI Non-Technical Research and Education(19:35) Lightcone Infrastructure(22:09) The AI Futures Project(23:50) Effective Institutions Project (EIP) (For Their Flagship Initiatives)(25:29) Artificial Intelligence Policy Institute (AIPI)(27:08) AI Lab Watch(28:09) Palisade Research(29:20) CivAI(30:15) AI Safety Info (Robert Miles)(31:00) Intelligence Rising(31:47) Convergence Analysis(32:43) IASEAI (International Association for Safe and Ethical Artificial Intelligence)(33:28) The AI Whistleblower Initiative(34:10) Organizations Related To Potentially Pausing AI Or Otherwise Having A Strong International AI Treaty(34:18) Pause AI and Pause AI Global(35:45) MIRI(37:00) Existential Risk Observatory(37:59) Organizations Focusing Primary On AI Policy and Diplomacy(38:37) Center for AI Safety and the CAIS Action Fund(40:17) Foundation for American Innovation (FAI)(43:07) Encode AI (Formerly Encode Justice)(44:12) The Future Society(45:08) Safer AI(45:47) Institute for AI Policy and Strategy (IAPS)(46:55) AI Standards Lab (Holtman Research)(48:01) Safe AI Forum(48:40) Center For Long Term Resilience(50:20) Simon Institute for Longterm Governance(51:16) Legal Advocacy for Safe Science and Technology(52:25) Institute for Law and AI(53:07) Macrostrategy Research Institute(53:41) Secure AI Project(54:20) Organizations Doing ML Alignment Research(55:36) Model Evaluation and Threat Research (METR)(57:01) Alignment Research Center (ARC)(57:40) Apollo Research(58:36) Cybersecurity Lab at University of Louisville(59:17) Timaeus(01:00:19) Simplex(01:00:52) Far AI(01:01:32) Alignment in Complex Systems Research Group(01:02:15) Apart Research(01:03:20) Transluce(01:04:26) Organizations Doing Other Technical Work(01:04:31) AI Analysts @ RAND(01:05:23) Organizations Doing Math, Decision Theory and Agent Foundations(01:06:44) Orthogonal(01:07:38) Topos Institute(01:08:34) Eisenstat Research(01:09:16) AFFINE Algorithm Design(01:09:45) CORAL (Computational Rational Agents Laboratory)(01:10:35) Mathematical Metaphysics Institute(01:11:40) Focal at CMU(01:12:57) Organizations Doing Cool Other Stuff Including Tech(01:13:08) ALLFED(01:14:46) Good Ancestor Foundation(01:16:09) Charter Cities Institute(01:16:59) Carbon Copies for Independent Minds(01:17:40) Organizations Focused Primarily on Bio Risk(01:17:46) Secure DNA(01:18:43) Blueprint Biosecurity(01:19:31) Pour Domain(01:20:19) ALTER Israel(01:20:56) Organizations That Can Advise You Further(01:21:33) Effective Institutions Project (EIP) (As A Donation Advisor)(01:22:37) Longview Philanthropy(01:24:08) Organizations That then Regrant to Fund Other Organizations(01:25:19) SFF Itself (!)(01:26:52) Manifund(01:28:51) AI Risk Mitigation Fund(01:29:39) Long Term Future Fund(01:31:41) Foresight(01:32:31) Centre for Enabling Effective Altruism Learning & Research (CEELAR)(01:33:28) Organizations That are Essentially Talent Funnels(01:35:24) AI Safety Camp(01:36:07) Center for Law and AI Risk(01:37:16) Speculative Technologies(01:38:10) Talos Network(01:38:58) MATS Research(01:39:45) Epistea(01:40:51) Emergent Ventures(01:42:34) AI Safety Cape Town(01:43:10) ILINA Program(01:43:38) Impact Academy Limited(01:44:15) Atlas Computing(01:44:59) Principles of Intelligence (Formerly PIBBSS)(01:45:52) Tarbell Center(01:47:08) Catalyze Impact(01:48:11) CeSIA within EffiSciences(01:49:04) Stanford Existential Risk Initiative (SERI)(01:49:52) Non-Trivial(01:50:27) CFAR(01:51:35) The Bramble Center(01:52:29) Final Reminders --- First published: November 27th, 2025 Source: https://www.lesswrong.com/posts/8MJQFHBWJgJ82FALJ/the-big-nonprofits-post-2025-1 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
224
“Book Review: If Anyone Builds It, Everyone Dies” by Zvi
Where ‘it’ is superintelligence, an AI smarter and more capable than humans. And where ‘everyone dies’ means that everyone dies. No, seriously. They’re not kidding. They mean this very literally. To be precise, they mean that ‘If anyone builds [superintelligence] [under anything like present conditions using anything close to current techniques] then everyone dies.’ My position on this is to add a ‘probably’ before ‘dies.’ Otherwise, I agree. This book gives us the best longform explanation of why everyone would die, with the ‘final form’ of Yudkowsky-style explanations of these concepts for new audiences. This review is me condensing that down much further, transposing the style a bit, and adding some of my own perspective. Scott Alexander also offers his review at Astral Codex Ten, which I found very good. I will be stealing several of his lines in the future, and [...] ---Outline:(01:22) What Matters Is Superintelligence(03:56) Rhetorical Innovation(05:14) Welcome To The Torment Nexus(06:50) Predictions Are Hard, Especially About the Future(08:32) Humans That Are Not Concentrating Are Not General Intelligences(11:18) Orthogonality(12:08) Intelligence Lets You Do All The Things(14:39) No Seriously We Mean All The Things(17:00) How To Train Your LLM (In Brief)(19:51) What Do We Want?(21:51) You Don't Only Get What You Train For(24:25) What Will AI Superintelligence Want?(25:52) What Could A Superintelligence Do?(27:43) One Extinction Scenario(33:14) So You're Saying There's A Chance(37:55) Oh Look It's The Alignment Plan(40:50) The Proposal: Shut It Down(48:26) Hope Is A Vital Part Of Any Strategy(48:55) I'm Doing My Part(53:34) Their Closing Words --- First published: September 19th, 2025 Source: https://www.lesswrong.com/posts/a89eTXZPy6kuuKchN/book-review-if-anyone-builds-it-everyone-dies-2 --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
-
223
“AI #131 Part 2: Various Misaligned Things” by Zvi
It doesn’t look good, on many fronts, especially taking a stake in Intel. We continue. Table of Contents America Extorts 10% of Intel. Nice company you got there. Who's next? The Quest For No Regulations Whatsoever. a16z is at it again, Brockman joins. The Quest for Sane Regulations. Dean Ball surveys the state legislative landscape. Chip City. Nvidia beats earnings, Huawei plans to triple chip production. Once Again The Counterargument On Chip City. Sriram Krishnan makes a case. Power Up, Power Down. I for one do not think windmills are destroying America. People Really Do Not Like AI. Some dislike it more than others. A lot more. Did Google Break Their Safety Pledges With Gemini Pro 2.5? I think they did. Safety Third at xAI. Grok 4 finally has a model card. Better late than never. [...] --- First published: September 12th, 2025 Source: https://www.lesswrong.com/posts/CWYomHppHsxNe9xRC/ai-131-part-2-various-misaligned-things-1 --- Narrated by TYPE III AUDIO. ---Images from the article:<img src="https://substackcdn.com/image/fetch/$s_!PMKW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4bf46f7a-5485-4e8c-8d4b-dbbd47ad761b_825x709.png" alt="Bar graph showing QA performance comparison across six AI models. The graph titled "Simple QA no browse" compares performance metrics (Refusal, Incorrect, Correct) for Opus 4, Sonnet 4, OpenAI 03, OpenAI c4-mini, GPT-4b, and GPT-4.1." style="max-width: 100%;" /><img src="https://substackcdn.com/image/fetch/$s_!0Era!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b73e787-a98f-4424-b3ee-b2b354f35f8c_1098x759.png" alt="Bar graph titled "Overrefusal Scores" comparing AI models' inappropriate refusal rates. The graph shows scores for six different AI models (Claude Opus 4, Claude Sonnet 4, GPT-4.1, GPT-4.0, c3, and c4-mini), with c3 having notably higher overrefusal scores compared to the other models. The data includes 95% confidence intervals represented by error bars." style="max-width: 100%;" />Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.
No matches for "" in this podcast's transcripts.
No topics indexed yet for this podcast.
Loading reviews...
ABOUT THIS SHOW
Audio narrations of LessWrong posts by zvi
HOSTED BY
zvi
CATEGORIES
Loading similar podcasts...