“grade GPUs that the paper used, you can see that some of…” — Dwarkesh Podcast at 2:32:29
“grade GPUs that the paper used, you can see that some of these algorithm tricks to speed up convergence just don't matter so much compared to something else. And I think that's a matter of taste in the present time. Yeah, interesting. How about the outer loop? How verifiable for making AI smarter?”
0:00
2:37:29