LLM As A Judge
from Linear Digressions Hosted by Katie Malone
Labeled data is expensive, slow, and painfully hard to come by — and when you're trying to evaluate whether an AI workflow is actually doing what you want, the problem gets even messier. How do you judge whether a chatbot response was helpful, honest, or hallucination-free at scale? This episode digs into using LLMs as judges: letting the models themselves evaluate the quality of AI outputs, from simple chat exchanges all the way to complex multi-step agent behavior.
Embed this episode
No transcript yet.
Similar podcasts
The Talk Show With John Gruber
Daring Fireball / John Gruber
The director’s commentary track for Daring Fireball. Long digressions on Apple, technology, design, movies, and more.
Getting Into Infosec
Ayman Elsawah
Interviews with people who have transitioned and got jobs in #infosec and #cybersecurity so you can learn and be inspired from their experience. There is no linear path into the field of Information Security, so the hope is that you will resonate with at least one of the guests. Some of my guests were teachers, paralegals, librarians, military vets, developers, and IT help desk techs (to name a few) before transitioning. Also featuring "spoof" ads poking fun at the industry.
Frequently asked questions
How long is this episode of Linear Digressions?
This episode is 30 minutes long.
When was this Linear Digressions episode published?
This episode was published on September 28, 2026.
Can I download this Linear Digressions episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.