The Embodiment Gap in Robot Foundation Models

1. Key Themes

The Embodiment Gap: Reusable Models vs. Physical Execution

The paper defines the "embodiment gap" as the hidden work required to make a shared model or representation actually run on a specific robot. As stated in the Abstract: "We call the gap between reusable models, representations, or data and their use in execution on the target robot the embodiment gap." This means that even if a foundation model generalizes well in theory, deploying it on a new robot body requires significant, often undocumented engineering to connect the model to that robot's physical control system and gripper.

Success Rate Hides Hidden Engineering Work

A core theme is that benchmark success rates are misleading for real-world deployment. The authors argue in Section 1: "The practical value of two systems can still differ when they require different amounts or kinds of work before reaching the same success rate." They point out that system integrators in industrial robotics have long done this "less visible work through experience and tacit knowledge," and the same applies to deploying modern Robot Foundation Models (RFMs). A 90% success rate means little if it required weeks of manual calibration and human intervention to achieve.

Three Scaling Directions Leave Different Gaps

The paper categorizes current RFM research into three directions: sharing semantics/perception, sharing robot data/interfaces, and learning correspondence across embodiments. Each leaves a different type of work on the target robot. For example, methods sharing semantics (like SayCan) leave the work of connecting plans to executable skills, while methods sharing data (like OpenVLA) leave the work of aligning model outputs with the target robot's controller (Section 3.3).

Safety and Recovery are Unsolved

The authors map 21 method groups and find that none adequately address safe stopping and recovery after failure. As noted in Section 3.2: "None of the 21 method groups was placed in the Safety / Recovery row. This finding does not mean that safety and recovery have been solved... the ability to stop safely after failure and resume or recover has not yet become a central research target of robot foundation models."

2. Contrarian Perspectives

Scaling Data and Models is Not Enough

While the industry is heavily focused on scaling data and model size, this paper argues that scaling alone cannot bridge the embodiment gap. In Section 1, the authors cite Ken Goldberg: "language and vision can draw on Internet-scale training data, whereas robotics cannot obtain observations paired with action commands at a similar scale." They add that "We still lack a clear account of which gaps between a shared model and execution on a target robot can be reduced by scaling data or models, and which remain as engineering work on that robot."

Standardized Interfaces Don't Guarantee Physical Execution

Many companies are building standardized data formats and teleoperation interfaces (like UMI or ALOHA) to share robot data. However, the paper challenges the assumption that a common format solves deployment. In Section 5, they state: "A common action representation does not guarantee common physical execution. The instruction to move an end effector slightly forward, for example, can produce a different amount of contact or pressure on another robot."

Morphology-Aware Models Don't Solve Contact

There is a trend toward building models that take robot kinematics into account (like Body Transformer or GET-Zero). The paper argues this only solves part of the problem. In Section 6, the authors note: "Knowing the kinematic structure does not determine how a real gripper presses against an object or how much it slips. Contact depends on the end-effector shape and material as well as the response of the real controller."

3. Companies Identified

• Physical Intelligence: Creators of the π0 and π0.5 vision-language-action models. Relevant as prominent examples of generalist robot policies that still require target-robot adaptation. Quote: "RT-X, Octo, OpenVLA, RoboCat, and the π0 family are prominent examples" (Section 1).
• Google DeepMind: Developers of RT-2, PaLM-E, SayCan, and contributors to RT-X/OXE. Relevant for their work in sharing semantics and perception, which still requires connection to executable skills. Quote: "SayCan, for example, matches action candidates proposed by a language model to skills that the target robot can execute" (Section 4).
• Hugging Face: Backers of the LeRobot open-source library. Relevant for providing frameworks that standardize software connections, though physical alignment still requires separate work. Quote: "LeRobot connects a shared data format to tools for training and deployment" (Section 5).

4. People Identified

• Ken Goldberg, UC Berkeley: Notable for arguing that robotics lacks internet-scale action data and that engineering must be combined with learning. Quote: "Goldberg argues that language and vision can draw on Internet-scale training data, whereas robotics cannot obtain observations paired with action commands at a similar scale" (Section 1).
• Yukiyasu Domae, AIST: Corresponding author of the paper, leading the definition of the embodiment gap and the reporting framework for adaptation work.
• Rémi Cadène, Hugging Face: Lead author of the LeRobot library, noted for creating shared data formats and deployment tools.
• Chelsea Finn, Stanford: Involved in multiple cited works (ALOHA, OpenVLA, π0), representing the frontier of generalist policies that still face the embodiment gap.

5. Operating Insights

Evaluate RFMs by Adaptation Work, Not Just Success Rate

CTOs and investors should demand transparency on the engineering work required to achieve a reported success rate. The paper proposes a "report card" (Table 1) to track items like target-robot data, calibration, and human interventions. As stated in Section 7: "A high success rate does not by itself show whether the system can operate continuously in the real world when the stopping and recovery process is unclear."

Plan for Contact and Safety Engineering

When deploying a foundation model on a new robot, expect significant engineering work around physical contact and safety, even if the model handles kinematics. The paper explicitly states in Section 8: "safe execution and recovery remain necessary parts of deployment." Teams should budget for "aligning coordinate frames and control rates, correcting unstable contact, and stopping or recovering safely after failure."

Data Collection Must Include the Adaptation Process

Companies should not just collect successful trajectories; they should record the process of adaptation, failure, and recovery. The authors argue in Section 8: "Data should preserve the process by which an action became executable, in addition to the final successful trajectory... A model that can learn why adjustment was needed, where execution failed, and how the system recovered may eventually learn part of the adaptation process itself."

6. Overlooked Insights

The Empty Safety/Recovery Row

A buried but critical finding is that out of 21 major method groups analyzed, zero address safety and recovery as a central feature. Figure 2 shows an empty "Safety / Recovery" row. The authors note: "Within the scope of this survey, the ability to stop safely after failure and resume or recover has not yet become a central research target of robot foundation models" (Section 3.2). This is a massive gap for commercial deployment where continuous operation is required.

Tactile and Force Data as the Next Frontier

The paper highlights that vision and kinematics are insufficient for contact-rich tasks, pointing to tactile and force data as the next necessary shared structure. In Section 6, they mention methods like TactAlign and ForceMimic, noting: "Touch can make contact easier to observe while creating new adaptation work for sharing those observations." The authors suggest that "future data should therefore include touch, force, sound, and changes during contact in addition to vision and language" (Section 8).