“harness, all of that, where if you are sort of tightly…” — The Bike Shed at 4:01
“harness, all of that, where if you are sort of tightly optimizing for the behavior that you want for your code against one model and then the model changes, then all of your prompt and code might not work as well with the new model. And so you might see a decrease. And it's possible that”
0:00
41:12