Show-Harness Gives VLMs a Robot Keyboard
from Embodied AI 101 Hosted by Shaoqing Tan
Uses discrete semantic actions paired with embodiment-specific interpreters to turn any pretrained VLM into a robot controller without a dedicated policy network or additional pretraining. Demonstrates strong zero-shot generalization across diverse tasks and environments. In this episode of Embodied AI 101, we explore "Show-Harness Gives VLMs a Robot Keyboard". We break down the research, methodology, and real-world implications for robotics, AI, and physical intelligence. Embodied AI 101 covers the latest research at the intersection of AI and physical intelligence — robotics, manipulation, world models, and the path from digital intelligence to embodied agents.
Embed this episode
What this episode covers
Uses discrete semantic actions paired with embodiment-specific interpreters to turn any pretrained VLM into a robot controller without a dedicated policy network or additional pretraining. Demonstrates strong zero-shot generalization across diverse tasks and environments.
No transcript yet.