Skip to content
Provably safe AGI, with Steve Omohundro episode artwork

Feb 13, 2024 43 min

Provably safe AGI, with Steve Omohundro

from London Futurists Hosted by London Futurists

AI systems have become more powerful in the last few years, and are expected to become even more powerful in the years ahead. The question naturally arises: what, if anything, should humanity be doing to increase the likelihood that these forthcoming powerful systems will be safe, rather than destructive? Our guest in this episode has a long and distinguished history of analysing that question, and he has some new proposals to share with us. He is Steve Omohundro, the CEO of Beneficial AI Research, an organisation which is working to ensure that artificial intelligence is safe and beneficial for humanity. Steve has degrees in Physics and Mathematics from Stanford and a Ph.D. in Physics from U.C. Berkeley. He went on to be an award-winning computer science professor at the University of Illinois. At that time, he developed the notion of basic AI drives, which we talk about shortly, as well as a number of potential key AI safety mechanisms. Among many other roles which are too numerous to mention here, Steve served as a Research Scientist at Meta, the parent company of Facebook, where he worked on generative models and AI-based simulation, and he is an advisor to MIRI, the Machine Intelligence Research Institute. Selected follow-ups: Steve Omohundro: Innovative ideas for a better world Metaculus forecast for the date of weak AGI "The Basic AI Drives" (PDF, 2008) TED Talk by Max Tegmark: How to Keep AI Under Control Apple Secure Enclave Meta Research: Teaching AI advanced mathematical reasoning DeepMind AlphaGeometry Microsoft Lean theorem prover Terence Tao (Wikipedia) NeurIPS Tutorial on Machine Learning for Theorem Proving (2023) The team at MIRI Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration Art Is Not a Thing From media art to digital activism: art as critical inquiry and world-building. Listen on: Apple Podcasts Spotify

Episode details come from the podcast's RSS feed.

Embed this episode

AI systems have become more powerful in the last few years, and are expected to become even more powerful in the years ahead. The question naturally arises: what, if anything, should humanity be doing to increase the likelihood that these forthcoming powerful systems will be safe, rather than destructive? Our guest in this episode has a long and distinguished history of analysing that question, and he has some new proposals to share with us. He is Steve Omohundro, the CEO of Beneficial AI Re...

Ready to play

Provably safe AGI, with Steve Omohundro

0:00 43:47

Chapters

  1. 8:56 [Ad] Art Is Not a Thing
  2. 9:46 (Cont.)

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of London Futurists?

This episode is 43 minutes long.

When was this London Futurists episode published?

This episode was published on February 13, 2024.

Can I download this London Futurists episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.