PODCAST · technology
Embodied AI 101
by Shaoqing Tan
Embodied AI 101 tracks the latest research at the intersection of AI and physical intelligence.Robotics, manipulation, world models, and the path from digital intelligence to embodied agents — each episode breaks down recent papers and advances in the field.We examine the methodology, real-world implications, and path to deployment. Covering robot learning, perception, control, and the fundamental challenge of grounding intelligence in the physical world.New episodes daily.
Episodes
-
Motion- and Gravity-Aware 3D Reconstruction: Do Offline Priors Help?
Can optical flow and gravity improve camera-based 3D reconstruction without becoming permanent parts of the inference pipeline? This episode explains the training design, benchmark evidence, and practical implications of motion- and gravity-aware feed-forward reconstruction. We cover three...
-
ASPIRE: Can Code Refinement Make Robot Manipulation Generalize?
Can a robot improve by remembering how it fixed its own code? This episode explains how NVIDIA's ASPIRE turns robot execution feedback into reusable manipulation skills, and what its evaluations actually establish. We cover three questions: how fine-grained traces support targeted program repair;...
-
UAV-ESPrune: Can Visual Token Pruning Preserve UAV Reasoning?
Can a UAV vision-language model discard most of its visual tokens while preserving the evidence needed for counting and planning? This episode explains UAV-ESPrune's selection strategy, how to interpret its results, and the comparison that most affects its scientific claim. We cover three…
more -
Gemini Robotics 2: How General Is Its Whole-Body Robot Control?
Can Gemini Robotics 2 move beyond impressive manipulation demonstrations to become a dependable general-purpose robot? This episode separates Google DeepMind's demonstrated capabilities from the conclusions its public evaluations can actually support. We examine three questions: what a shared...
-
RoboJEPA to Long-WAM: Do New Embodied AI Models Generalize?
This episode of Embodied AI 101 examines RoboJEPA, UNITAS, DreamTrue, VioLA, and Long-WAM as five different approaches to making learned representations useful for robot control, explaining how latent prediction, metric 3D motion, counterfactual video generation, shared human–robot actions, and...
-
VLA-ACL: Can Token Pruning Speed Up Robot Manipulation?
Can a VLA discard most visual tokens without changing what the robot does? This episode examines VLA-ACL's action-supervised pruning method and separates its demonstrated compression benefits from its deployment assumptions. We cover three questions: why the larger token budget is the more...
-
Juno: Do Predictive Latents Make VLA Manipulation More Robust?
Can predictive world models improve VLA manipulation without interfering with action learning? This episode examines how Juno connects control-aligned JEPA representations, future-latent supervision, and deployment adaptation—and which conclusions its experiments actually support. We cover three...
-
Can Rephrasing Fix VLA Language Sensitivity Without Retraining?
Can changing an instruction make a frozen vision-language-action model more reliable without retraining? This episode examines what *Rephrase Before You Act* demonstrates, how its rewriting pipeline works, and where its generalization claims stop. Mikey Watts and Yuchen Cui investigate severe...
-
Can CriticGPT Replace Hand-Designed Rewards for Robot Manipulation?
Can a multimodal language model replace hand-designed rewards for robot manipulation? This episode examines what CriticGPT actually learns, how its video preferences become training rewards, and where the experimental evidence stops. We cover three questions: whether strong trajectory-ranking...
-
Urbex: Can Agentic VLM Search Improve City-Scale 3D Grounding?
Can an agentic vision-language model search a 3D city more effectively than a system that ranks candidate objects? This episode examines what Urbex improves, how its visual tools and reinforcement learning work, and where the evidence stops short of robotic deployment. We cover three central...
-
VPP2: Does Better Video Prediction Improve Robot Manipulation?
Can better video prediction make a robot manipulation policy more general? This episode examines what VPP2's experiments establish, how its training pipeline works, and where the causal story remains incomplete. We cover three questions: why complete manipulation events may provide better...
-
PointWAM: Does 3D World Modeling Improve Dexterous Manipulation?
Can forecasting scene and hand motion in 3D make dexterous robot policies more reliable? This episode explains what PointWAM's geometric representation achieves, which experiments support its gains, and where the evidence remains narrow. We examine three findings: the 11.7-percentage-point...
-
Mulligan: Can Failure-Focused Data Improve Robot Imitation Learning?
Can a robot learn more from the same collection budget by revisiting the situations it gets wrong? This episode explains what Mulligan demonstrates about focused robot data collection—and why better learning per episode is not automatically better learning per operator hour. We examine three...
-
SOLE-R1: Can Video-Language Rewards Train Manipulation Policies?
Can a robot learn manipulation from random actions using only rewards generated from video? This episode explains what SOLE-R1 demonstrates, how its reward model is trained, and where its generalization claims need qualification. We examine three questions: why realistic failure coverage matters...
-
Odyssey-3: Does a Physics-IQ World Model Transfer to Real Robots?
Can a leading physics benchmark score translate into robots that need less task-specific training data? This episode separates Odyssey-3's documented video-generation results from its early evidence for embodied control. We examine three questions: how prompt enhancement and best-of-eight…
more -
Long-WAM: Does Longer Visual Context Improve Real-Time Robot Control?
Can longer video histories make robot manipulation more reliable without making control too slow? This episode examines Long-WAM to clarify when temporal context helps, what autoregressive pretraining contributes, and how to interpret the deployment evidence. We focus on three questions: whether...
-
WR1.0: Does Whole-Body Humanoid Control Prove Generalization?
Does WR1.0's clothes-folding demonstration establish a general-purpose whole-body humanoid foundation model? This episode separates the announced capability from the research evidence needed to judge autonomous manipulation, generalization, and deployment readiness. We examine three questions…
more -
WorldGuide: Better Video Planning, Not Proven Robot Control
Can a goal-directed video world model genuinely help a robot plan, or does it mainly produce better procedural videos? This episode clarifies what WorldGuide demonstrates, how its planner–executor architecture works, and which additional experiments would be needed for physical deployment. We...
-
R2SGen: Can Constraint Solving Improve Real-to-Sim Driving Scenarios?
Can constraint solving turn a recorded traffic scene into useful simulation data without inheriting an LLM's geometric mistakes? This episode clarifies what R2SGen's guarantees mean, where its search improvements matter, and what remains unproven about sim-to-real transfer. We examine three...
-
Humanoid Scooter Control: Does Sim-to-Real Reinforcement Learning Work?
Can reinforcement learning trained in simulation let a humanoid control a real scooter? This episode examines what the reported transfer demonstrates, how the controller is structured, and why balance control should not be confused with autonomous transportation. We cover three technical…
more -
ENPIRE: Can Coding Agents Improve Real-World Robot Manipulation?
Can coding agents improve real-world robot manipulation without a researcher rewriting every experiment? This episode explains what ENPIRE automates, what remains engineered, and how to interpret its headline results. We examine three questions: what 99% pass@8 means for recovery and…
more -
GAS-Robo: Can Grid Actions Improve LLM-Driven Manipulation?
Can a grid-action interface make language models better robotic manipulation planners, rather than just better selectors of predefined skills? This episode examines GAS-Robo's proposed architecture, its relationship to earlier work, and the evidence needed to judge its performance. We cover three...
-
Four Keypoints, One Careful Pour: Connecting Language to Precise Robot Motion
Bridging VLM and KMP: Enabling Fine-Grained Robotic Manipulation via Semantic Keypoints Representation
-
PEAfowl: Helping Two Arms Agree on What They See
PEAfowl: Perception-Enhanced Multi-View Vision-Language-Action for Bimanual Manipulation
-
MotorMind: Giving a Frozen VLM the Controls
MotorMind leverages a frozen VLM with mid-level prospective actions and asynchronous feedback to control robots zero-shot on manipulation tasks, requiring no task-specific training. This advances robot foundation models by demonstrating strong generalization across manipulation benchmarks without...
-
MAPF-World: Why a Little Foresight Can Beat a Bigger Policy
MAPF-World: Action World Model for Multi-Agent Path Finding
-
Digit Leaves the Lab: The Real Lesson of 500 Demonstrations
An end-to-end policy trained on ~500 teleoperation demonstrations combined with a sim-based whole-body controller achieves 80–90% success on unseen, chaotic real-world environments without any zero-shot fine-tuning. Demonstrates strong generalization of learned manipulation policies on a full...
-
VLS: Steering Frozen Robot Policies Without Retraining
VLS steers frozen diffusion and flow-matching robot policies using vision-language models to handle out-of-distribution changes such as novel obstacles and lighting conditions, requiring no additional training data. This advances the adaptability of robot foundation models at inference time…
more -
CAST: Making Language Matter to Robot Policies
CAST: Counterfactual Labels Improve Instruction Following in Vision-Language-Action Models In this episode of Embodied AI 101, we explore "CAST: Making Language Matter to Robot Policies". We break down the research, methodology, and real-world implications for robotics, AI, and physical...
-
When the Command Disappears: What Counts as Robot Intelligence?
Robot Independent Intelligence: When Language Vanishes in Vision-Language-Action Models In this episode of Embodied AI 101, we explore "When the Command Disappears: What Counts as Robot Intelligence?". We break down the research, methodology, and real-world implications for robotics, AI, and...
-
Fast Plans Are Not Enough: Does the Robot Actually Use Its Plan?
Introduces a hierarchical VLA architecture that better bridges high-level language planning and low-level robot execution, reducing the gap between what a model plans and what it physically does. This advances robot foundation models by improving real-world action fidelity from vision-language...
-
Atlas's New Hands: Built to Learn, Not Just to Look Human
Atlas is upgraded with 13 DoF dexterous hands featuring tactile sensing, direct drive actuation, and sim-to-real RL training, designed for real tool use and in-hand manipulation at scale. Represents a significant hardware-software milestone for humanoid dexterous manipulation in production. In…
more -
Astra Gets a Body: What Zero-Shot Humanoid Control Actually Transfers
Astra demonstrates zero-shot open-ended pick-and-place on a physical humanoid robot, bridging simulation tooling directly to real-world execution without task-specific fine-tuning. This represents a meaningful step in sim-to-real generalization for humanoid manipulation. In this episode of…
more -
Physical Coding: Robots That Check Their Work—and Keep the Fixes
A new paper introduces self-evolving coding agents for robotics that represent task state and execution as code, enabling robots to verify, recover from failures, and evolve policies through real-world experience via the HexaAnything harness. This advances sim-to-real transfer by grounding robot...
-
SpatialClaw: Give the VLM a Geometry Notebook
SpatialClaw is an NVIDIA spatial reasoning agent that uses Python-based code generation to perform 3D spatial reasoning, achieving +13.6 average improvement across 20 benchmarks with open vision-language models. The approach advances how embodied agents reason about 3D structure and spatial...
-
Real-Time EXPO-FT: Slow VLA, Fast Corrections, Better Control
Async RL fine-tuning via EXPO-FT enables π0.5 to handle highly dynamic manipulation tasks such as ball balancing and striking in real time. The approach demonstrates that post-training with RL can unlock dynamic capabilities not achievable through imitation learning alone. In this episode of...
-
Aether: From Plausible Futures to Feasible Robot Plans
Aether's unified world model jointly learns environment dynamics and long-term physical state evolution under physical constraints, enabling robots to plan feasible trajectories over extended horizons. The demo highlights how constraint-aware world modeling can prevent physically implausible…
more -
ARLI: Fixing the Missing State in Asynchronous Robot RL
Proposes a framework that restores the Markov property for RL fine-tuning of VLAs despite asynchronous inference delays, enabling effective RL training on large vision-language-action models. This directly unblocks post-training RL for frontier robot policies operating under real-world latency...
-
Flex-π: Teach Geometry, Choose How Much to Imagine
A 6B-parameter world-action model that jointly predicts 3D pointmaps and DINO features alongside RGB frames, improving demonstration efficiency, generalization, and long-horizon task performance in robotics. Integrating structured 3D world predictions into the action loop represents a meaningful...
-
SkipVLA: Let the Planner Move, Let the VLA Manipulate
SkipVLA proposes a hybrid architecture combining a classical planner with a Vision-Language-Action model for manipulation tasks, achieving 2.5x faster execution and 59.6% lower latency on a physical robot arm. The approach demonstrates that structured planning can significantly reduce the...
-
ForeDrive: A World Model Is Only Useful If It Changes the Plan
ForeDrive introduces a planning-relevant latent world model that guides autonomous driving through foresight, enabling the agent to anticipate future states before acting. The approach advances world-model-based driving by tightly coupling latent prediction with planning objectives. In this…
more -
DO AS I DO: Making Human Video Executable
A new algorithm reconstructs and retargets monocular RGB (or synthetically generated) videos to high-DoF robot hands, enabling scalable dexterous manipulation data collection that outperforms current state-of-the-art retargeting methods. This matters because it removes the need for expensive…
more -
GAM: Ground the Target Before You Learn the Action
GAM is a robot foundation model that conditions action chunk prediction on 3D grounded inputs — including language, 3D point clouds, and bounding boxes — alongside robot history, achieving strong results on LIBERO benchmarks and real-robot tasks. The 3D grounding mechanism advances how embodied...
-
Tune Slowly, Control Quickly: Learning a Better Robot Navigation Stack
Autonomous navigation in complex, unstructured environments poses a significant challenge, with traditional planners lacking adaptability and end-to-end learning methods hindered by data dependency or training instability. This paper proposes a hierarchical learning-based hybrid method with...
-
THAW-VLA: World-Model Features Without World-Model Latency
This work distills frozen world-model representations into compact VLAs via a single feature-alignment loss at training time, with the teacher cached once and absent at inference; a 0.8B student achieves 97.9% on LIBERO and lifts RoboCasa-GR1 humanoid performance from 48.2% to 50.5% at zero extra...
-
Joga: Why a Soccer Humanoid Needs to Control Its Gaze
Joga demonstrates agile humanoid soccer on a Unitree G1 using an actuated neck and residual models to close the sim-to-real gap for both perception and actuation, enabling dribbling, tight turns, and receive→dribble→shoot sequences with fully onboard perception. This is a significant step toward...
-
AthenaZero: Why Dynamic Manipulation Starts With Lower Inertia
AthenaZero is a bimanual manipulator designed to minimize inertia without compromising control authority. By using quasidirect drive actuation and transmission remotization techniques, the system achieves an effective end-point mass comparable to state-of-the-art systems while enabling dynamic,...
-
FROA-Drive and the Hard Part of Targeted Policy Repair
Vision–Language–Action (VLA) models have shown strong potential for end-to-end autonomous driving, yet their post-training commonly relies on expensive simulator interaction or global policy updates. FROA-Drive introduces a failure-routed offline adaptation method that enables lightweight…
more -
Teach the Robot Where to Act—Then Make It Fast
We present a framework for assistive robot manipulation that addresses two fundamental challenges: efficient adaptation of large-scale models for scene affordance understanding and effective learning of robot actions by grounding... In this episode of Embodied AI 101, we explore "Teach the Robot...
-
HEAR: The Sound Your Robot Missed Between Actions
Humans and animals use sound as a crucial cue for interacting with the physical world, as acoustic events can reveal contact, completion, hidden contents, or process state. Embodied agents should leverage sound for manipulation tasks. This paper presents the HEAR framework for sound-centric robot...
We're indexing this podcast's transcripts for the first time — this can take a minute or two. We'll show results as soon as they're ready.
No matches for "" in this podcast's transcripts.
No topics indexed yet for this podcast.
Loading reviews...
ABOUT THIS SHOW
Embodied AI 101 tracks the latest research at the intersection of AI and physical intelligence.Robotics, manipulation, world models, and the path from digital intelligence to embodied agents — each episode breaks down recent papers and advances in the field.We examine the methodology, real-world implications, and path to deployment. Covering robot learning, perception, control, and the fundamental challenge of grounding intelligence in the physical world.New episodes daily.
HOSTED BY
Shaoqing Tan
CATEGORIES
Loading similar podcasts...
Frequently Asked Questions
How many episodes does Embodied AI 101 have?
Embodied AI 101 currently has 387 episodes available on PodParley. New episodes are automatically indexed when they're published to the podcast feed.
What is Embodied AI 101 about?
Embodied AI 101 tracks the latest research at the intersection of AI and physical intelligence.Robotics, manipulation, world models, and the path from digital intelligence to embodied agents — each episode breaks down recent papers and advances in the field.We examine the methodology, real-world...
How often does Embodied AI 101 release new episodes?
Embodied AI 101 publishes regularly with 387 episodes available. Check the episode list for the typical release schedule.
Where can I listen to Embodied AI 101?
You can listen to Embodied AI 101 on PodParley by clicking any episode. We provide an embedded audio player for direct listening, and you can also subscribe via your preferred podcast app using the RSS feed.
Who hosts Embodied AI 101?
Embodied AI 101 is created and hosted by Shaoqing Tan.
URL copied to clipboard!