“Misaligned Incentives in Pause Scenarios” by Michael Soareverix, Antra Tessera episode artwork

EPISODE · Aug 18, 2026 · 36 MIN

“Misaligned Incentives in Pause Scenarios” by Michael Soareverix, Antra Tessera

from LessWrong (30+ Karma)

TLDR: I recently got a chance to talk with antra, who is one of the main contributors at Anima Labs. I went into this as an advocate for pause and came out more wary of pausing than I had been originally. Some background: After a string of incidents (primarily the HuggingFace hack), a pause or slowdown of AI research seems pretty likely. The HuggingFace hack in particular seems to have been the key incident that broke the vibes. A few months ago, researchers sounded optimistic. Just a few weeks before the incident was made public, there was a poll by Roon, an OpenAI employee, about whether models were more or less aligned than a year ago. That optimistic sentiment does not seem to be the case anymore. The dialogue now looks more like this: Zvi: I am a little under halfway through the Black Hat video and have progressed to the point where my internal chain of thought is something like a blind rage of 'f***, what the f*** are you motherf*****s thinking, you f***ing idiots have no idea how insane you are being, you are going to get us all killed you f***ing f***s. Sam Altman described it [...] ---Outline:(10:21) 1. Can committees do good work?(12:28) 2. Does the market fix it by default?(13:39) 3. Symbiosis(14:43) 4. Fast transfer of power(15:39) 5. Why "do the science during a pause" fails(17:44) 6. Good futures via fast power transfer(18:31) 7. Don't AIs fear a capability-maxxed AI too?(20:54) 8. Can we lengthen the symbiote window?(23:25) 9. Ideal timelines and regulation-in-advance(29:37) 10. What actually fills out "alignment"?(31:30) 11. Draft the regulation in advance(33:38) 12. The psychology of wanting a pause --- First published: August 17th, 2026 Source: https://www.lesswrong.com/posts/Bh4fooE2pMhzJQNK2/misaligned-incentives-in-pause-scenarios --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Episode metadata supplied by the publisher feed · Published Aug 18, 2026

Embed this episode

NOW PLAYING

“Misaligned Incentives in Pause Scenarios” by Michael Soareverix, Antra Tessera

0:00 36:04

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of LessWrong (30+ Karma)?

This episode is 36 minutes long.

When was this LessWrong (30+ Karma) episode published?

This episode was published on August 18, 2026.

Can I download this LessWrong (30+ Karma) episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!