“it means you care about some tokens much more than others.…” — Dwarkesh Podcast at 8:23
“it means you care about some tokens much more than others. And they're rare enough that it's like the loss function over focuses on kind of the appearance, the things that are responsible for the most bits of entropy. And instead, you know, they don't focus on this stuff that's really essential. And so you could kind…”
0:00
1:58:43