Skip to content
Can LLMs Hide Hallucinations in Their Internal Truth Representations? (Research by Google) episode artwork

Dec 13, 2024 8 min

Can LLMs Hide Hallucinations in Their Internal Truth Representations? (Research by Google)

from New Paradigm: AI Research Summaries Hosted by James Bentley

This episode analyzes the research paper titled **"LLM Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations,"** authored by Hadas Orgad, Michael Toker, Zorik Gekhman, Roi Reichart, Idan Szpektor, Hadas Kotek, and Yonatan Belinkov from Technion, Google Research, and Apple. It explores the phenomenon of hallucinations in large language models (LLMs), examining how these models internally represent truthfulness and encode information within specific tokens. The discussion highlights key findings such as the localization of truthfulness signals, the challenges in generalizing error detection across different datasets, and the discrepancy between internal knowledge and outward responses. Additionally, the episode reviews the implications of these insights for improving error detection mechanisms and enhancing the reliability of LLMs in various applications. This podcast is created with the assistance of AI, the producers and editors take every effort to ensure each episode is of the highest quality and accuracy. For more information on content and research relating to this episode please see: https://arxiv.org/pdf/2410.02707

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Can LLMs Hide Hallucinations in Their Internal Truth Representations? (Research by Google)

0:00 8:14

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of New Paradigm: AI Research Summaries?

This episode is 8 minutes long.

When was this New Paradigm: AI Research Summaries episode published?

This episode was published on December 13, 2024.

Can I download this New Paradigm: AI Research Summaries episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.