045 - Will AI Kill Us in 10 Years?

Will AI kill us within the next ten years? The question stopped sounding like pure science fiction the week an Anthropic researcher resigned over it. This episode separates the Terminator-style fear from the risks worth taking seriously, using the news that prompted the question and the numbers behind it. On September 9, 2026, Anthropic researcher Jacob Coxon resigned, warning that frontier labs are racing toward self-improving superintelligence and, in his words, gambling with our lives. Around the same time, Anthropic's Alignment Science Lead, Evan Hubinger, said he personally puts the chance of AI killing all humans within a decade above ten percent. The episode is careful about what that figure is: one researcher's personal estimate, not an Anthropic forecast, and Hubinger himself notes that current models pose relatively low risk. From there, the episode walks through concrete ways AI could cause serious harm well short of extinction. It looks at AI-assisted hacking, including Anthropic's reports of models finding unknown vulnerabilities and gaining unauthorized access in security testing. It covers the fragility of the infrastructure AI depends on, citing the International Energy Agency's projection that data-center electricity use could roughly double between 2025 and 2030. It examines jobs, with the International Labour Organization's estimate that one in four workers globally have some exposure to generative AI, and the IMF's figure that about forty percent of global employment is exposed in some way. It turns to financial stability and the Bank for International Settlements' warning that many institutions running similar AI models could react to shocks in the same way and amplify market swings. And it closes on the hardest case: increasingly autonomous systems that can accelerate their own development faster than humans can evaluate or control them. The takeaway is practical rather than apocalyptic. The most credible danger may be a chain of connected failures across systems we cannot afford to lose, rather than a single machine turning against us. For a grounded read on AI extinction risk, AI safety, and the Coxon resignation without the hype, this episode lays out what deserves your attention. Sources & References CNBC — Anthropic researcher quits AI safety https://www.cnbc.com/2026/09/09/anthropic-researcher-quits-ai-safety.html Financial Times — Anthropic researcher quits over AI labs 'gambling with our lives' https://www.ft.com/content/20c07191-8da6-440f-b04b-8ea0ebdd9153 Anthropic — Mapping AI-enabled cyber threats https://www.anthropic.com/research/attack-navigator Anthropic — Trustworthy agents in practice https://www.anthropic.com/research/trustworthy-agents Anthropic — Improving our alignment and security efforts https://www.anthropic.com/news/improving-alignment-security-efforts International Labour Organization — Generative AI and jobs: A 2025 update https://www.ilo.org/publications/generative-ai-and-jobs-2025-update IMF — New Skills and AI Are Reshaping the Future of Work https://www.imf.org/en/blogs/articles/2026/01/14/new-skills-and-ai-are-reshaping-the-future-of-work Bank for International Settlements — Progress and peril https://www.bis.org/publications/aer-2026/progress-peril International Energy Agency — Energy and AI https://www.iea.org/reports/energy-and-ai Voice narration is AI-generated.