PodParley PodParley
PodParley
Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022

EPISODE · Jul 26, 2023 · 1H 3M

Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022

from Mystery AI Hype Theater 3000 · host Emily M. Bender and Alex Hanna

Emily and Alex are joined by Dr. Jeremy G. Kahn to discuss the distressingly large number of evaluation metrics for artificial intelligence, and some new AI hell.Jeremy G. Kahn has a PhD in computational linguistics, with a focus on information-theoretic and empirical engineering approaches to dealing with natural language (in text and speech). He’s gregarious, polyglot, a semi-auto-didact, and occasionally prolix. He also likes comic books, coffee, progressive politics, information theory, lateral thinking, science fiction, science fact, linear thinking, bicycles, beer, meditation, love, play, and inquiry. He lives in Seattle with his wife Dorothy and son Elliott.This episode was recorded on December 12, 2022.Watch the video of this episode on PeerTube.References:XKCD: StandardsWikidataConGish GallopThe Bender RuleDJ Khaled - You Played YourselfJeff Kao's interrogation of public comment periods.Emily's blog post response to NYT pieceCheck out future streams on Twitch. Meanwhile, send us any AI Hell you see.Find our book The AI Con here, and MAIHT3k merch here.Subscribe to our newsletter via Buttondown.Follow us!EmilyBluesky: emilymbender.bsky.socialMastodon: dair-community.social/@EmilyMBenderAlexBluesky: alexhanna.bsky.socialMastodon: dair-community.social/@alexTwitter: @alexhannaMusic by Toby Menon.Artwork by Naomi Pleasure-Park. Production by Ozzy Llinas Goodman.

NOW PLAYING

Episode 7: There Are Now 15 Competing Evaluation Metrics (ft. Dr. Jeremy Kahn). December 12, 2022

0:00 1:03:14

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

NFTStatistics explains the current state of NFT buying behavior

Mar 24, 2023 ·61m

This Outfit Does Not Exist is making you rethink fashion

Mar 18, 2023 ·56m

G and Soby: NFTParis, Alpha on 9dcc Iteration 03 and EIC - 4337's future use cases.

Mar 3, 2023 ·61m

SNUFFY creates art generated by your personality

Feb 24, 2023 ·42m

Farokh and Cory Van Lew Surprise gmoney with an Honorary PFP

Feb 13, 2023 ·54m

How to Succeed As A Trader with Seefood

Feb 6, 2023 ·54m

Similar Podcasts

How NOT to be Broke Julie Creffield Welcome to "How Not to be Broke" with serial entrepreneur and business legacy strategist Julie Creffield. This podcast is dedicated to challenging perceptions of wealth and worthiness, shining the spotlight on social mobility and the opportunity to use business as a vehicle for change, without the "We can all be millionaires" BS. As a seasoned business growth strategist, Julie has a track record of transforming the lives and businesses of over 3000 solopreneurs, helping them shape their legacy and work towards financial freedom.But beyond that her work as a consultant, and change-maker over the past 25 years has seen her impact on the lives of millions of ordinary people.From her humble beginnings to her success as an international keynote speaker and author, Julie has a story way beyond the traditional "Rags to Riches" oneEach episode is packed with wisdom drawn from her experience, showcasing how to take immediate, fearless action on your vision, make smart tactical decisio Explicit Making Gold: an AI Adventure One businessman's journey into the wild world of AI. I am leaving behind 3 profitable businesses and going all in on this AI thing. Documenting the journey and discovering what it takes to make a golden opportunity in the AI space. Explicit Elon Musk Fail Marlawn Heavenly VII Elon Musk Fail: Podcast consist of improv research and catalyzes imaginary conversations that seek to advance the science and practice of character, with a focus on moral, performance, civic, and intellectual virtues such as curiosity, diligence, fearlessness and honesty.WHO IS SHERLOCK HOMEBOY?Sherlock Homeboy is unique compared to an average human, but he is not a “high-functioning sociopath.” Sherlock Homeboy most likely suffers from Asperger's Syndrome, a minor case of Bipolar Disorder, and a hint of Savant Syndrome. Asperger's Syndrome causes Sherlock Homeboy to think in pictures. He is extremely antisocial, also classified as aromantic and sapiosexual, never has love affairs and shuns society, with a split personality. Sherlock Homeboy is not just a outside of the box thinker, but a mystery himself. Aside from his obvious inability to behave in a social settings, his obvious lack of regard for the rules there is also the fact that his skills are not infallible. In rea Explicit Chinook Realm Religion and crime collide when a gruesome murder rocks the isolated community of Chinook, Montana. Local Deputy Ruth Vogel thought she was answering a routine animal control call, only to find a mangled corpse on the frozen embankment. Her small town is whipped into a frenzy and everyone is quick to point their fingers at a drug-addicted teenager, but Ruth suspects connections to a powerful religious group. Enter Agent Loro, an enigmatic FBI investigator tracking an evangelical cult that may have roots right here in Chinook. Loro and Ruth form a cautious partnership to find the killer—but as the mystery winds through Ruth’s life, her family, and her church, she’ll discover something more sinister than murder is afoot.Binge all episodes of Chinook exclusively and ad-free by joining Wondery+ in the Wondery App, Apple Podcasts or Spotify. Start your free trial by wondery.com/links/chinook v Explicit
URL copied to clipboard!