EPISODE · May 9, 2025 · 37 MIN
The case for a conditional AI safety treaty, with Otto Barten
from London Futurists · host London Futurists
How can a binding international treaty be agreed and put into practice, when many parties are strongly tempted to break the rules of the agreement, for commercial or military advantage, and when cheating may be hard to detect? That’s the dilemma we’ll examine in this episode, concerning possible treaties to govern the development and deployment of advanced AI.Our guest is Otto Barten, Director of the Existential Risk Observatory, which is based in the Netherlands but operates internationally. In November last year, Time magazine published an article by Otto, advocating what his organisation calls a Conditional AI Safety Treaty. In March this year, these ideas were expanded into a 34-page preprint which we’ll be discussing today, “International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treaty”.Before co-founding the Existential Risk Observatory in 2021, Otto had roles as a sustainable energy engineer, data scientist, and entrepreneur. He has a BSc in Theoretical Physics from the University of Groningen and an MSc in Sustainable Energy Technology from Delft University of Technology.Selected follow-ups:Existential Risk ObservatoryThere Is a Solution to AI’s Existential Risk Problem - TimeInternational Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treaty - Otto Barten and colleaguesThe Precipice: Existential Risk and the Future of Humanity - book by Toby OrdGrand futures and existential risk - Lecture by Anders Sandberg in London attended by OttoPauseAIStopAIResponsible Scaling Policies - METRMeta warns of 'worse' experience for European users - BBC NewsAccidental Nuclear War: a Timeline of Close Calls - FLIThe Vulnerable World Hypothesis - Nick BostromSemiconductor Manufacturing Optics - ZeissCalifornia Institute for Machine ConsciousnessTipping point for large-scale social change? Just 25 percent - Penn TodayMusic: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain DeclarationC-Suite PerspectivesElevate how you lead with insight from today’s most influential executives.Listen on: Apple Podcasts Spotify
What this episode covers
How can a binding international treaty be agreed and put into practice, when many parties are strongly tempted to break the rules of the agreement, for commercial or military advantage, and when cheating may be hard to detect? That’s the dilemma we’ll examine in this episode, concerning possible treaties to govern the development and deployment of advanced AI. Our guest is Otto Barten, Director of the Existential Risk Observatory, which is based in the Netherlands but operates internationally...
NOW PLAYING
The case for a conditional AI safety treaty, with Otto Barten
No transcript for this episode yet