“but also machines can take this test too. So whereas other…” — Y Combinator Startup Podcast at 2:05
“but also machines can take this test too. So whereas other benchmarks, they might try to do what I call PhD++ problems, harder and harder. So we had MMLU, we had an MMLU+, and now we have Humanity's last exam. Those are going superhuman, right? ARC benchmarks, normal people can do these. And so we actually test all…”
0:00
11:59