“guideline of like, if you pass their your quality results…” — The Pragmatic Engineer at 1:10:08
“guideline of like, if you pass their your quality results may be degrading. The biggest tell I see for this is often the models trying to get the test pass and you're 200k talking about, well, let me try this. Okay, let me try that. And it's like trying a bunch of stuff and it's getting more”
0:00
1:32:24