“Right. So this is a pretty tricky problem in practice. And…” — Dwarkesh Podcast at 1:35:36
“Right. So this is a pretty tricky problem in practice. And so this is where advantage estimation happens in reinforcement learning. So you want to subtract, um, you know, a term from, from, um, from your, your multiplier instead of an indicator function of like one and zero,”
0:00
2:37:29