Better Know a Benchmark: Humanity's Last Exam
from Linear Digressions Hosted by Katie Malone
Humanity's Last Exam was designed with a bold premise: questions that human experts can answer, but AI models can't. Originally dubbed "Humanity's Last Stand," this benchmark is a massive academic collaboration — hundreds of contributors, thousands of fiendishly hard questions spanning a wild range of domains. In this Better Know a Benchmark installment, we unpack what HLE is actually testing, how it was built, and what it means when a model finally starts cracking it.
Embed this episode
No transcript yet.
Similar podcasts
The Talk Show With John Gruber
Daring Fireball / John Gruber
The director’s commentary track for Daring Fireball. Long digressions on Apple, technology, design, movies, and more.
Getting Into Infosec
Ayman Elsawah
Interviews with people who have transitioned and got jobs in #infosec and #cybersecurity so you can learn and be inspired from their experience. There is no linear path into the field of Information Security, so the hope is that you will resonate with at least one of the guests. Some of my guests were teachers, paralegals, librarians, military vets, developers, and IT help desk techs (to name a few) before transitioning. Also featuring "spoof" ads poking fun at the industry.
Frequently asked questions
How long is this episode of Linear Digressions?
This episode is 23 minutes long.
When was this Linear Digressions episode published?
This episode was published on August 17, 2026.
Can I download this Linear Digressions episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.