“In the last few years, when people tried to forecast the…” — Dwarkesh Podcast at 1:27:30
“In the last few years, when people tried to forecast the MMLU benchmark, which was having a lot of more sophisticated graduate student science kind of questions, AI knocked that down a lot faster than AI researchers and students who had registered forecasts on it. And so if you're getting top-notch scores on graduate…”
0:00
2:44:16