“Yeah, but we don't pay a quadratic cost. If you were…” — Latent Space: The AI Engineer Podcast at 18:34
“Yeah, but we don't pay a quadratic cost. If you were looking at the star coder baseline, it would get even more expensive way more quickly. So it's actually, these 16K runs become very tractable for a lot of groups. But yeah, we could push it to 32K. We could push it to 64K. We could probably push it beyond that…”
0:00
32:59