Skip to content
Ep#48: VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generation episode artwork

Dec 4, 2025 55 min

Ep#48: VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generation

from RoboPapers Hosted by Chris Paxton

Robots must often be able to move around and interact with objects in previously-unseen environments to be useful. And the interaction part is important; to do this, they must be able to perceive and interact with the world using onboard sensing. Enter VisualMimic. Shaofeng Yin and Yanjie Ze show us how to use visual sim-to-real to train diverse loco-manipulation tasks, which can even handle diverse outdoor environments. Learn more in Episode #48 of RoboPapers today, hosted by Michael Cho and Chris Paxton. Abstract: Humanoid loco-manipulation in unstructured environments demands tight integration of egocentric perception and whole-body control. However, existing approaches either depend on external motion capture systems or fail to generalize across diverse tasks. We introduce VisualMimic, a visual sim-to-real framework that unifies egocentric vision with hierarchical whole-body control for humanoid robots. VisualMimic combines a task-agnostic low-level keypoint tracker -- trained from human motion data via a teacher-student scheme -- with a task-specific high-level policy that generates keypoint commands from visual and proprioceptive input. To ensure stable training, we inject noise into the low-level policy and clip high-level actions using human motion statistics. VisualMimic enables zero-shot transfer of visuomotor policies trained in simulation to real humanoid robots, accomplishing a wide range of loco-manipulation tasks such as box lifting, pushing, football dribbling, and kicking. Beyond controlled laboratory settings, our policies also generalize robustly to outdoor environments. Videos are available at: this https URL . Project Page: https://visualmimic.github.io/ ArXiV: https://arxiv.org/abs/2509.20322 This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit robopapers.substack.com

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Ep#48: VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generation

0:00 55:46

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of RoboPapers?

This episode is 55 minutes long.

When was this RoboPapers episode published?

This episode was published on December 4, 2025.

Can I download this RoboPapers episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.