Skip to content
The Optimizer Becomes a Policy: Inside RP-1's Learned Planner for Robot World Models episode artwork

Sep 3, 2026 30 min

The Optimizer Becomes a Policy: Inside RP-1's Learned Planner for Robot World Models

from Embodied AI 101 Hosted by Shaoqing Tan

Pantheon Industries introduces Reinforced Planning (RP-1), the first fully learned planner that iteratively improves robot action plans from scratch using Reinforcement Learning over a frozen World Model. RP-1 reimagines planning as a learned policy: starting with a candidate action sequence, it uses a frozen World Model to imagine outcomes, a learned critic to evaluate closeness to goal (value-based scoring instead of latent distance), and a neural planner to revise the sequence over multiple iterations. This replaces hand-designed search heuristics (CEM, MPPI, Adam) with learned, reusable plan-improvement rules. Key results across ThreeRoom, OGBench, and Reacher benchmarks: RP-1 beats SOTA latent methods on 48 of 48 head-to-head comparisons, achieves 2.2x higher success rate on hard and long-horizon tasks, is 67x faster at scale (50 robot arms on H200 GPUs), and requires 1000x fewer World Model queries than MPPI/CEM. In this episode of Embodied AI 101, we explore "The Optimizer Becomes a Policy: Inside RP-1's Learned Planner for Robot World Models". We break down the research, methodology, and real-world implications for robotics, AI, and physical intelligence. Embodied AI 101 covers the latest research at the intersection of AI and physical intelligence — robotics, manipulation, world models, and the path from digital intelligence to embodied agents.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

The Optimizer Becomes a Policy: Inside RP-1's Learned Planner for Robot World Models

0:00 30:54

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Embodied AI 101?

This episode is 30 minutes long.

When was this Embodied AI 101 episode published?

This episode was published on September 3, 2026.

Can I download this Embodied AI 101 episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.