Skip to content
WorldGuide: Better Video Planning, Not Proven Robot Control episode artwork

Oct 9, 2026 28 min

WorldGuide: Better Video Planning, Not Proven Robot Control

from Embodied AI 101 Hosted by Shaoqing Tan

Can a goal-directed video world model genuinely help a robot plan, or does it mainly produce better procedural videos? This episode clarifies what WorldGuide demonstrates, how its planner–executor architecture works, and which additional experiments would be needed for physical deployment. We examine three central questions: why visual feedback produces stronger evidence than the narrow headline baseline win; why a valid text plan is not equivalent to successful execution; and what released code and checkpoints do—and do not—make reproducible. WorldGuide combines a Qwen-based planner with a HunyuanVideo executor for generated procedures such as folding, construction, and cooking. Its benchmarks evaluate visual task execution, not a physical robot platform. We place the work alongside Video Language Planning, ORCA, VideoWorld 2, and NovaPlan to distinguish generated-state feedback from feedback grounded in real observations. The discussion also covers known-task versus unseen-task generalization, noisy completion supervision, evaluation uncertainty, and configuration details that matter when reproducing results. For practitioners, the focus is a concrete adaptation path: retain the action–observation supervision structure, test progress recognition with existing robot skills, and measure whether imagined futures actually improve action selection. What happens when reality contradicts the generated plan?

Episode details come from the podcast's RSS feed.

Embed this episode

WorldGuide is a video world model designed for goal-directed procedural task execution, enabling embodied agents to plan and execute multi-step tasks by predicting future visual states conditioned on goals. It advances the use of world models as explicit planning infrastructure for embodied agents.

Ready to play

WorldGuide: Better Video Planning, Not Proven Robot Control

0:00 28:08

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Embodied AI 101?

This episode is 28 minutes long.

When was this Embodied AI 101 episode published?

This episode was published on October 9, 2026.

Can I download this Embodied AI 101 episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.