Michael Nielsen on Hyper-entities, Tools for Thought, and Wise Optimism

If you think people who worry about AI are being pessimistic, you might have it backwards.In this episode, we talk with Michael Nielsen, scientist and writer known for his work on open science, quantum computing, and how our language shapes the way we think. Michael explores what he calls "wise optimism": the idea that genuinely believing in a technology's potential means taking its risks seriously, not dismissing them. We also spend a good chunk of the conversation on “hyper-entities”. These are imagined future objects, like the Internet before the 1990s or AGI now, that shape present decisions – what gets funded, who coordinates with whom, and what feels possible. We recently published a report where we systematically looked for hyper-entities and spotlighted our favorites: https://www.existentialhope.com/hyper-entitiesOur conversation also covers:How kindness spread through civilization like a technology, and what that tells us about the values we might want to instill in AI  Why some of the most important scientific discoveries happened by accident Why even the most abstract and "useless" ideas in science tend to end up shaping the real world, both positively and negativelyHow the tools we use to think (from language to mathematical notation to software) shape what we're able to imagine‍Timestamps0:00 Cold open1:34 What is a hyper-entity? How imagined future objects orient technological progress6:30 Why Silicon Valley depends on but undervalues hyper-entities9:08 Can science fiction generate the next big tech idea?11:03 Should we be more deliberate about designing hyper-entities?13:44 Why belief in AGI exploded: self-fulfilling prophecy and the power of conviction16:04 Beyond AGI: renewable energy, public goods, and other neglected hyper-entities20:25 Wise optimism about AI: why taking risks seriously is more optimistic than ignoring them24:22 The dual-use problem: why deep scientific knowledge is always also dangerous27:44 What our visions of the future get wrong: emotions, values, and AI identity38:27 Where breakthroughs really come from: exploration vs. goal-directed research44:43 A serious discipline for imagining the future: vision papers and validated imagination56:08 Tools for thought: how symbols and notation expand what humans can think1:02:49 Intellectual independence and the art of productive disagreementOn the Existential Hope Podcast hosts Allison Duettmann and Beatrice Erkers from the Foresight Institute invite scientists, founders, and philosophers for in-depth conversations on positive, high-tech futures. Full transcript, listed resources, and more: https://www.existentialhope.com/podcastsFollow on X. Hosted on Acast. See acast.com/privacy for more information.