“much worse at processing information from further and…” — Latent Space: The AI Engineer Podcast at 3:21
“much worse at processing information from further and further back in the past. And this is why you see the funny phenomena of long context models sometimes being really good at using things at the very beginning of their context and really good at using things at the very end of the context, but sort of messing up…”
0:00
32:59