Are AI benchmarks doomed? episode artwork

EPISODE · May 1, 2026 · 1H 5M

Are AI benchmarks doomed?

from Epoch After Hours · host Epoch AI

AI benchmarks saturate quickly, struggle to capture what we care about, and cost more than ever to build. But are they doomed? Greg Burnham, who leads Epoch's benchmarking team, and Tom Adamczewski, who developed MirrorCode, push back on the pessimism and dig into what the next generation of AI benchmarks could look like.

AI benchmarks saturate quickly, struggle to capture what we care about, and cost more than ever to build. But are they doomed? Greg Burnham, who leads Epoch's benchmarking team, and Tom Adamczewski, who developed MirrorCode, push back on the pessimism and dig into what the next generation of AI benchmarks could look like.

NOW PLAYING

Are AI benchmarks doomed?

0:00 1:05:25

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Epoch After Hours?

This episode is 1 hour and 5 minutes long.

When was this Epoch After Hours episode published?

This episode was published on May 1, 2026.

What is this episode about?

AI benchmarks saturate quickly, struggle to capture what we care about, and cost more than ever to build. But are they doomed? Greg Burnham, who leads Epoch's benchmarking team, and Tom Adamczewski, who developed MirrorCode, push back on the...

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Epoch After Hours episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!