ChatGPT Part 1 (S04E03)
from The Technium Hosted by The Technium
ChatGPT is a language model by OpenAI which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. 00:00 S04E03 ChatGPT Part 1 02:58 What is ChatGPT? 06:17 Lineage of ChatGPT 10:01 General Reasoning from Training on Code 25:13 Reinforcement Learning from Human Feedback 29:37 Dumb compute, stacked high 42:00 Talking to an Alien Intelligence 45:14 What's it good at and bad at? 56:05 The XY problem 01:03:36 GPT in Education 01:13:26 Eating High Status Jobs, Fulfilling Latent Demand Links: - https://chat.openai.com/ - https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulator#Simulators - http://www.incompleteideas.net/IncIdeas/BitterLesson.html - https://xyproblem.info/ ===== About “The Technium” ===== The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more! ===== Socials ===== WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Embed this episode
What this episode covers
ChatGPT is a language model by OpenAI which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests.
Chapters
- 0:00 S04E03 ChatGPT Part 1
- 2:58 What is ChatGPT?
- 6:17 Lineage of ChatGPT
- 10:01 General Reasoning from Training on Code
- 25:13 Reinforcement Learning from Human Feedback
- 29:37 Dumb compute, stacked high
- 42:00 Talking to an Alien Intelligence
- 45:14 What's it good at and bad at?
- 56:05 The XY problem
- 1:03:36 GPT in Education
- 1:13:26 Eating High Status Jobs, Fulfilling Latent Demand
No transcript yet.