EPISODE · Oct 11, 2026 · 27 MIN
Mulligan: Can Failure-Focused Data Improve Robot Imitation Learning?
from Embodied AI 101 · host Shaoqing Tan
Can a robot learn more from the same collection budget by revisiting the situations it gets wrong? This episode explains what Mulligan demonstrates about focused robot data collection—and why better learning per episode is not automatically better learning per operator hour. We examine three questions: how failed-state retries and counterfactual demonstrations differ from ordinary DAgger corrections; what value-based action selection adds beyond the imitation policy; and how to interpret the blinded, paired real-robot results. The experiments cover marker insertion, nut placement, and cable routing on a Franka Panda, alongside simulated square-nut insertion. We also unpack a consequential simulation caveat: some collection rounds use feedback from the fixed evaluation grid to guide training-state selection. The practical discussion focuses on failure logging, coverage-only controls, independent acceptance tests, and measuring human time rather than treating every supervised episode as equally expensive. The release offers substantial reproducibility support, but a fresh human-in-the-loop campaign remains a new experiment. Before investing in another policy architecture, should you change which failures your operator teaches next?
Embed this episode
What this episode covers
Mulligan targets failure-prone initial states during real-robot deployment rather than uniform sampling, making DAgger-style imitation learning significantly more data-efficient. Validated across 3 real tasks with 2,550 blind evaluations, it improves policy performance at the same human annotation budget.
Ready to play
Mulligan: Can Failure-Focused Data Improve Robot Imitation Learning?
No transcript for this episode yet
Similar Episodes
No similar episodes found.