EP263: How POPO ends AI training waste

Title: RLVR without Ineffective Samples: Group Prioritized Off-Policy Optimization for LLM ReasoningSource: http://arxiv.org/abs/2606.01281v1Summary:This paper introduces POPO, a novel optimization framework that solves the critical zero-variance reward bottleneck in Reinforcement Learning with Verifiable Rewards (RLVR) for LLM reasoning. By implementing prioritized group replay and decoupled off-policy optimization, it provides a foundational efficiency breakthrough for training reasoning-intensive models with significantly reduced rollout overhead.