Next-Token Predictor Is An AI's Job, Not Its Species episode artwork

EPISODE · Apr 2, 2026 · 16 MIN

Next-Token Predictor Is An AI's Job, Not Its Species

from Astral Codex Ten Podcast

I. In The Argument, Kelsey Piper gives a good description of the ways that AIs are more than just "next-token predictors" or "stochastic parrots" - for example, they also use fine-tuning and RLHF. But commenters, while appreciating the subtleties she introduces, object that they're still just extra layers on top of a machine that basically runs on next-token prediction. I want to approach this from a different direction. I think overemphasizing next-token prediction is a confusion of levels. On the levels where AI is a next-token predictor, you are also a next-token (technically: next-sense-datum) predictor. On the levels where you're not a next-token predictor, AI isn't one either.

Episode metadata supplied by the publisher feed · Published Apr 2, 2026

Embed this episode

NOW PLAYING

Next-Token Predictor Is An AI's Job, Not Its Species

0:00 16:14

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

No similar podcasts found.

Frequently Asked Questions

How long is this episode of Astral Codex Ten Podcast?

This episode is 16 minutes long.

When was this Astral Codex Ten Podcast episode published?

This episode was published on April 2, 2026.

Can I download this Astral Codex Ten Podcast episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!