“the memory instead of memorizing every single thing that…” — Latent Space: The AI Engineer Podcast at 14:13
“the memory instead of memorizing every single thing that it's seen. Import and a one-line change and it'll, you're off to the races. You'll see huge speedups if you're doing any sort of training or inference on long contexts. Yeah. And, you know, the other thing is this is not a change that requires pre-training. So…”
0:00
32:59