[Problem profile] “Catastrophic AI misuse” by The 80,000 Hours team

On July 16, 1945, humanity had a disturbing first: scientists tested a technology — nuclear weapons — that could cause the destruction of civilisation. Since the attacks on Hiroshima and Nagasaki, humanity hasn’t launched any more nuclear strikes. In part, this is because our institutions developed international norms that, while imperfect, managed to prevent more nuclear attacks. We expect advanced AI will speed up technological advances, with some expecting a century of scientific progress in a decade. Faster scientific progress could have enormous benefits, from cures for deadly diseases to space exploration. Yet this breakneck pace could lower the barriers to creating devastating new weapons while outpacing our ability to build the safeguards needed to control them. Without proper controls, a country, group, or individual could use AI-created weapons of mass destruction to cause a global catastrophe. Advanced AI systems may dramatically accelerate scientific progress, potentially compressing decades of research into just a few years. This rapid advancement could enable the development of devastating new weapons of mass destruction — including enhanced bioweapons and entirely new categories of dangerous technologies — faster than we can build adequate safeguards. Without proper controls, state and non-state actors could use AI-developed [...] Narrated by AI. ---Outline:(01:09) Summary(01:59) Advanced AI could accelerate scientific progress(04:56) What kinds of weapons could advanced AI create?(05:01) Bioweapons(07:27) Cyberweapons(08:22) New dangerous technologies(09:56) These weapons would pose global catastrophic risks(12:33) There are promising approaches to reducing these risks(12:53) Governance and policy approaches(14:36) Technical approaches to reduce misuse risks The original text contained 5 footnotes which were omitted from this narration. --- First published: June 24th, 2025 Source: https://80000hours.org/problem-profiles/catastrophic-ai-misuse --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.