Skip to content
(Voiceover) Building on evaluation quicksand episode artwork

Oct 16, 2024 16 min

(Voiceover) Building on evaluation quicksand

from Interconnects Hosted by Nathan Lambert

Read the full post here: https://www.interconnects.ai/p/building-on-evaluation-quicksand Chapters 00:00 Building on evaluation quicksand 01:26 The causes of closed evaluation silos 06:35 The challenge facing open evaluation tools 10:47 Frontiers in evaluation 11:32 New types of synthetic data contamination 13:57 Building harder evaluations Figures Fig 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/manual/openai-predictions.webp This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.interconnects.ai/subscribe

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

(Voiceover) Building on evaluation quicksand

0:00 16:36

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

Audistorium Stygian Catalyst Audistorium is a multi-genre spanning dark anthology audio drama created by Landon 'Lemon' Whisnant. From dread horror to absurdist comedy, Audistorium weaves a web of its own that interconnects It's stories in its own macabre, sometimes goofy way. Produced by Stygian Catalyst and co-creator of the Questionable Guide to Life Podcast. At the caring chiding of those close to us, we have decided to open up a way for people to contribute to the shows production, for the price of a simple cup of coffee, you can support Audistorium by clicking here for our Ko-Fi page. For contact, email us at [email protected], We can be found @AudistoriumPod on Twitter You can find Landon <a href="https://open.acast.com/shows/653838418299010011ba94bc/episodes/@https://twitter.com/Lemjam LCE Insider LC Elektronik LCE Insider is a podcast about real-life applications of printed electronics in industrial, medical and transport devices. It’s made for CEOs, design engineers, buyers and project managers who work with HMI – or want to enter this world. We talk about membrane keypads, printed circuits, sensors, backlighting and flexible interconnects, plus decisions like Europe vs Asia, cost vs risk and supplier strategy. Created by LC Elektronik, a Polish manufacturer and HMI integrator.

Frequently asked questions

How long is this episode of Interconnects?

This episode is 16 minutes long.

When was this Interconnects episode published?

This episode was published on October 16, 2024.

Can I download this Interconnects episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.