“we do not have good cost-efficient ways to scale up the…” — Latent Space: The AI Engineer Podcast at 2:04
“we do not have good cost-efficient ways to scale up the context. And this is something that might be surprising given how far everybody has pushed their context lengths in recent years. But actually, what a lot of people are doing is not solving the core underlying problem behind the very expensive cost of long…”
0:00
32:59