“However, the problem is you spend most of training in this…” — Dwarkesh Podcast at 2:17:12
“However, the problem is you spend most of training in this regime, right? Like in the low pass rate regime. And in fact, if how fast you're learning is a function of how many bits per sample you're getting, and you're getting very little signal here, if you chart the pass rate on a log scale,”
0:00
2:37:29