Awaken-HI: Scaling Humanoid Intelligence with Whole-Body Human Experience
1. Key Themes
Human Data Scaling Laws Directly Translate to Robot Success
The paper demonstrates a clear, empirical scaling law: as you feed a robot model more data of humans performing everyday tasks, the robot gets measurably better at executing those same tasks. By scaling human pretraining data from 5,000 to 50,000 hours, the model's action prediction error decreased, and the mean success rate on three household tasks jumped from 56.7% to 90.0%. As stated in Section 5.1, "scaling human pretraining data from 5,000 to 50,000 hours raises mean success from 56.7% to 90.0%." This proves that investing in large-scale human data collection is not just an academic exercise, but a direct driver of real-world robot performance.
Retaining Original Human Motion is Critical for Robot Learning
A common approach in the industry is to "retarget" human motion data—translating human joint movements into equivalent robot joint movements—and train the robot solely on that translated data. This paper challenges that by showing that the original, un-translated human motion contains valuable "priors" that get lost in translation. The authors use a "shared action expert" that simultaneously learns to predict both the original human motion and the retargeted robot actions. As noted in Section 4, "By directly learning the original human motion, the model acquires motion priors unaltered by retargeting." Ablation studies in Table 4 confirm that adding human motion supervision was the single most impactful auxiliary objective, boosting mean real-robot success from 13.3% to 43.3% in their test configuration.
State-of-the-Art Performance in Whole-Body Loco-Manipulation
Awaken-HI achieves a 93.75% mean success rate across eight individual tasks that require coordinating walking, posture changes, and hand movements (loco-manipulation). This significantly outperforms competing foundation models from NVIDIA and Physical Intelligence. According to Table 2, "Awaken-HI leads on all eight tasks... with a mean success rate of 93.75% that exceeds those of $\pi_{0.5}$ and GR00T N1.7 by 36.25 and 35.0 percentage points, respectively." The model also excels in long-horizon tasks (completing multiple tasks in a row without resetting), achieving 90% success on an industrial stocking task compared to 10% for $\pi_{0.5}$ and 30% for GR00T N1.7.
2. Contrarian Perspectives
Retargeting Human Motion to Robot Actions is Insufficient on Its Own
Most robotics companies that use human video data simply convert (retarget) the human movements into robot movements and train on that. This paper argues that this process introduces too many errors due to differences in body proportions. As stated in Section 2.3, "constrained by morphological differences, retargeting inevitably introduces global errors and distorted postures." By forcing the model to also predict the original human motion alongside the robot actions, they achieve better results. This suggests that companies relying solely on retargeted data are leaving significant performance on the table.
You Don't Need Thousands of Hours of Robot Teleoperation to Get High Success Rates
There is a heavy industry focus on scaling up robot teleoperation data (humans physically controlling robots to collect data), which is expensive and slow. This paper shows that with the right architecture, you can achieve state-of-the-art results with a surprisingly small amount of robot data. The model was "post-trained on approximately 150 hours of T800 teleoperation data" (Section 1). The heavy lifting in terms of learning general manipulation and movement skills was done by the 50,000 hours of human data. This implies that the bottleneck is not robot teleoperation, but rather the collection of high-quality human egocentric data.
3. Companies Identified
EngineAI
- Description: The authors of the paper and creators of the T800 humanoid robot.
- Why relevant: They built the dataset, the model, and the robot used for evaluation. They are demonstrating a vertically integrated stack from data collection to hardware.
- Quotes: "We conduct experiments on EngineAI T800 using approximately 150 hours of teleoperation demonstrations for robot post-training." (Section 5)
NVIDIA
- Description: Creators of GR00T N1.7, a foundation model for humanoid robots.
- Why relevant: GR00T N1.7 is used as a primary baseline. Awaken-HI significantly outperforms it, indicating EngineAI's approach is currently superior in this specific loco-manipulation benchmark.
- Quotes: "Awaken-HI outperforms both baselines on all eight individual loco-manipulation tasks... outperforms GR00T N1.7" (Abstract)
Physical Intelligence
- Description: Creators of $\pi_{0.5}$, a vision-language-action model with open-world generalization.
- Why relevant: $\pi_{0.5}$ is the other primary baseline. Awaken-HI's dominance over it, particularly in long-horizon tasks (80% vs 20% on household tidying), shows the strength of the human pretraining approach.
- Quotes: "Awaken-HI outperforms both baselines... and $\pi_{0.5}$ in both individual and long-horizon evaluations." (Abstract)
PICO
- Description: Provider of VR headsets and body-tracking systems.
- Why relevant: PICO hardware was used to collect the massive 50,000-hour dataset, showing a viable, scalable hardware path for data collection.
- Quotes: "Our setup consists of a PICO headset and five body-worn trackers, synchronously recording stereo RGB video and skeletal sequences from PICO’s body-tracking system" (Section 3.1)
4. People Identified
Xuanyi Li
- Lab/Institution: EngineAI
- Why notable: Project lead for Awaken-HI. His team's work on scaling human data and the shared action expert architecture is a significant contribution to the field of humanoid robotics.
- Quotes: "† denotes the project lead... Xuanyi Li†" (Section 7)
Chelsea Finn
- Lab/Institution: Physical Intelligence / Stanford
- Why notable: Co-author of $\pi_{0.5}$ and HumanPlus, both referenced in the paper. Her work on VLA models and human-to-humanoid transfer represents the conventional approach that this paper builds upon and outperforms.
- Quotes: Referenced in the context of $\pi_{0.5}$ [16] and HumanPlus [10].
Linxi "Jim" Fan
- Lab/Institution: NVIDIA
- Why notable: Co-author of GR00T N1.7, a primary baseline. His work represents the foundation model approach from a major hardware player, which EngineAI's method currently surpasses in these benchmarks.
- Quotes: Referenced in the context of GR00T N1.7 [31].
5. Operating Insights
Invest in Large-Scale Human Data Collection, Not Just Robot Teleoperation
The empirical scaling law presented in this paper is a clear signal for CTOs and investors. The most cost-effective way to improve robot performance may not be scaling up expensive robot teleoperation farms, but rather deploying wearable sensors to humans performing everyday tasks. As shown in Figure 6, scaling human data from 5k to 50k hours yielded a 33.3 percentage point increase in real-robot success. Companies should evaluate whether their data acquisition strategy is overly weighted toward robot data when human data offers a more scalable path to generalization.
Use a Shared Action Expert Architecture for Human-to-Robot Transfer
For engineering teams building VLA models, the architecture matters. Instead of training a model solely on retargeted robot actions, implement a "shared action expert" that simultaneously predicts the original human motion, wrist poses, and the retargeted robot actions. As detailed in Section 4.1, "Sharing the action expert allows the original human motion to supervise the same parameters used for robot action prediction." This forces the network to learn the underlying intent and motion priors from the human data, which then improves the quality of the robot action predictions.
6. Overlooked Insights
The Retargeting Pipeline Quality is a Critical Bottleneck
While the paper champions the use of original human motion, it also reveals that the quality of the retargeted robot actions is still incredibly important. The authors had to develop a custom, T800-specific retargeting pipeline to make the data usable. As stated in Section 3.3, "Compared with the original GMR pipeline, our pipeline reduces mean end-effector position error from 16.423 cm to 2.422 cm and mean orientation error from 39.590° to 15.596°." This massive reduction in error (from 16cm to 2.4cm) suggests that even with a shared expert, if your retargeting pipeline is poor, your robot actions will be poor. Companies cannot ignore the engineering effort required for high-fidelity retargeting.
Depth and Subtask Prediction as Auxiliary Tasks Improve Visual Representations
Buried in the ablation studies is the finding that adding depth estimation and subtask description during pretraining significantly improves the model's visual understanding. Figure 7 shows that a model trained with depth supervision produces feature maps where "the arms stand out against a smoother background," whereas the base model produces "large, nearly uniform regions." This indicates that forcing a VLA model to predict geometric properties like depth during pretraining is a cheap and effective way to improve its spatial awareness for manipulation tasks.