“when both of those things are kind of far back enough in…” — The Pragmatic Engineer at 29:49
“when both of those things are kind of far back enough in the context window that they're only half getting attended to, your likelihood that it's like actually going to like, remember the exact instructions you gave it 100,000 tokens ago is like, it goes down quite significantly.”
0:00
1:32:24