“action is like the average value minus the current one.…” — Dwarkesh Podcast at 2:11:40
“action is like the average value minus the current one. So, like, people can try to estimate Q in an off-policy way and then like just use advantage here and then, and then the sort of, if there's a problem in these dynamics that it doesn't like blow up your loss as much. And so, in robotics,”
0:00
2:37:29