“our training happens. You have a bunch of checkable…” — Dwarkesh Podcast at 6:43
“our training happens. You have a bunch of checkable synthetic problems. You do a bunch of RL against them. And nowhere in the training process, I'm guessing was like the model solving anything as ambitious as a millennium price problem. But the generalization was strong enough that you could”
0:00
1:20:10