Episode 28: LLMs Are Not Human Subjects, March 4 2024

from Mystery AI Hype Theater 3000 · host Emily M. Bender and Alex Hanna

Alex and Emily put on their social scientist hats and take on the churn of research papers suggesting that LLMs could be used to replace human labor in social science research -- or even human subjects. Why these writings are essentially calls to fabricate data.References:PNAS: ChatGPT outperforms crowd workers for text-annotation tasksBeware the Hype: ChatGPT Didn't Replace Human Data AnnotatorsChatGPT Can Replace the Underpaid Workers Who Train AI, Researchers SayPolitical Analysis: Out of One, Many: Using Language Models to Simulate Human SamplesBehavioral Research Methods: Can large language models help augment English psycholinguistic datasets?Information Systems Journal: Editorial: The ethics of using generative AI for qualitative data analysisFresh AI Hell:Advertising vs. reality, synthetic Willy Wonka editionhttps://x.com/AlsikkanTV/status/1762235022851948668?s=20https://twitter.com/CultureCrave/status/1762739767471714379https://twitter.com/xriskology/status/1762891492476006491?t=bNQ1AQlju36tQYxnm8BPVQ&s=19A news outlet used an LLM to generate a story...and it falsely quoted EmilyAI Invents Quote From Real Person in Article by Bihar News Site: A Wake-Up Call?Trump supporters target Black voters with faked AI imagesSeeking Reliable Election Information? Don’t Trust AICheck out future streams on Twitch. Meanwhile, send us any AI Hell you see.Find our book The AI Con here, and MAIHT3k merch here.Subscribe to our newsletter via Buttondown.Follow us!EmilyBluesky: emilymbender.bsky.socialMastodon: dair-community.social/@EmilyMBenderAlexBluesky: alexhanna.bsky.socialMastodon: dair-community.social/@alexTwitter: @alexhannaMusic by Toby Menon.Artwork by Naomi Pleasure-Park. Production by Ozzy Llinas Goodman.

What this episode covers

NOW PLAYING

0:00 1:00:57

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

Frater Aleftheria

Apr 6, 2026 ·91m

David Sater : Mythopoetic Alchemy

Apr 5, 2026 ·100m

The Seed Form & The Fourfold Veil

Jul 22, 2025 ·37m

The Aether Reborn

Jul 22, 2025 ·13m

Frater R. C. : The Ethics of Understanding God | H.O.G.D. | Magick

Feb 16, 2025 ·185m

Sarah Janes : Dream Mysteries, Enkoimesis & The Asclepeion

Jan 30, 2025 ·70m

Similar Podcasts

Chinook Realm Religion and crime collide when a gruesome murder rocks the isolated community of Chinook, Montana. Local Deputy Ruth Vogel thought she was answering a routine animal control call, only to find a mangled corpse on the frozen embankment. Her small town is whipped into a frenzy and everyone is quick to point their fingers at a drug-addicted teenager, but Ruth suspects connections to a powerful religious group. Enter Agent Loro, an enigmatic FBI investigator tracking an evangelical cult that may have roots right here in Chinook. Loro and Ruth form a cautious partnership to find the killer—but as the mystery winds through Ruth’s life, her family, and her church, she’ll discover something more sinister than murder is afoot.Binge all episodes of Chinook exclusively and ad-free by joining Wondery+ in the Wondery App, Apple Podcasts or Spotify. Start your free trial by wondery.com/links/chinook v Explicit TCAST: The Future of Data & AI TARTLE The Data Intelligence Podcast (TCAST) explores the intersection of AI, data privacy, and ethical technology. Join Alexander McCaig and Jason Rigby as they decode the future of data ownership, artificial intelligence, and digital privacy with industry leaders, researchers, and innovators.Each episode delivers actionable insights on:AI and machine learning developmentsData privacy and ownership strategiesEthical technology implementationReal-world applications of data intelligenceFuture trends in digital identity and data marketplacesPerfect for tech leaders, data scientists, privacy advocates, and forward-thinking professionals looking to understand and shape the future of data and AI.Presented by TARTLE, pioneers in ethical data exchange and AI enhancement. New episodes every week.The show is hosted by Co-Founder and Source Data Pioneer Alexander McCaig and Head of Conscious Marketing Jason Rigby.What's your data worth? Find out at (https://tartle.co/)Watch the podcast on Yo Explicit The Others Manic Bee Media Mabel, a young troubled botanist takes a job on a space station bound for a new world and a new life. But when the ship collides with unknown debris new alien life finds her instead. Mabel must outwit her pacifist AI and win a war against the aliens if she hopes to survive. Explicit Elon Musk Fail Marlawn Heavenly VII Elon Musk Fail: Podcast consist of improv research and catalyzes imaginary conversations that seek to advance the science and practice of character, with a focus on moral, performance, civic, and intellectual virtues such as curiosity, diligence, fearlessness and honesty.WHO IS SHERLOCK HOMEBOY?Sherlock Homeboy is unique compared to an average human, but he is not a “high-functioning sociopath.” Sherlock Homeboy most likely suffers from Asperger's Syndrome, a minor case of Bipolar Disorder, and a hint of Savant Syndrome. Asperger's Syndrome causes Sherlock Homeboy to think in pictures. He is extremely antisocial, also classified as aromantic and sapiosexual, never has love affairs and shuns society, with a split personality. Sherlock Homeboy is not just a outside of the box thinker, but a mystery himself. Aside from his obvious inability to behave in a social settings, his obvious lack of regard for the rules there is also the fact that his skills are not infallible. In rea Explicit

Frequently Asked Questions

How long is this episode of Mystery AI Hype Theater 3000?

This episode is 1 hour and 0 minutes long.

When was this Mystery AI Hype Theater 3000 episode published?

This episode was published on March 13, 2024.

What is this episode about?

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Mystery AI Hype Theater 3000 episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.

URL copied to clipboard!