“another one that is 100 k long. So, there's 100 k possible…” — Dwarkesh Podcast at 2:13:47
“another one that is 100 k long. So, there's 100 k possible tokens that one can answer. And you have a totally untrained model. And you have a prompt like, the sky is, with supervised learning, what would happen is that the model would have some probability distribution over all the things you could say.”
0:00
2:37:29