Skip to content
Ep. 11 - The Brain Behind the Bot: Decoding AI's Hidden World  episode artwork

Apr 4, 2025 42 min

Ep. 11 - The Brain Behind the Bot: Decoding AI's Hidden World

from In the Long Run Hosted by Joao Dias Ferreira, Marie Bemler, Jim Tolman

Welcome to "In the Long Run," the podcast where we explore technology, data, and AI decision-making. In this episode, Jim and João discuss Anthropic's research on mechanistic interpretability, which aims to reverse-engineer neural networks to understand how AI models actually work. They compare AI models to human brains as "black boxes" with unclear internal processes and explore how multilingual models like Claude may use a universal "concept language" internally before translating to specific human languages. The conversation also touches in the part of the study that reveals evidence that AI models plan multiple words ahead rather than simply predicting one word at a time. We further discuss the shift from "large language models" to "foundation models" as these systems now incorporate multiple modalities including text, images, and audio. They highlight GPT-4's new image generation capabilities that recently dominated social media with "Ghiblifying" images. The episode concludes with AI news including Google's Gemini 2.5 release, OpenAI's plans for an open-weight model, and the adoption of Model Context Protocol as a potential industry standard for AI tools.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Ep. 11 - The Brain Behind the Bot: Decoding AI's Hidden World

0:00 42:37

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of In the Long Run?

This episode is 42 minutes long.

When was this In the Long Run episode published?

This episode was published on April 4, 2025.

Can I download this In the Long Run episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.