Open-HumanScale: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models

1. Key Themes

Human Video Data as a Scalable Foundation for Robot Policies

The paper demonstrates that large-scale egocentric human video—paired with hand-motion and language annotations—can serve as a highly effective pretraining source for robot foundation models. By curating a 50,000-hour corpus (Open-HumanWAM-50K), the authors trained HumanWAM-Vanilla, a world-action model that achieves a 92.08% success rate on the RoboTwin 2.0 Clean2Clean benchmark and 68.88% on Clean2Random after robot post-training (Abstract). This proves that abundant, low-cost human video data can instill robust manipulation priors that transfer to physical robot control.

The Log-Linear Scaling Law for Egocentric Pretraining

The authors systematically investigate how pretraining data scale affects downstream robot success rates, uncovering an empirical log-linear scaling law. As stated in Section 3.2, "Downstream success follows an empirical log-linear scaling law, SR = a+b log10 H, where H denotes egocentric pretraining hours." They found that scaling from 100 to 50,000 hours of human video consistently improves out-of-distribution generalization, with scene-OOD success increasing from 49.1% to 73.2% and random success rising from 21.5% to 42.9% (Section 3.2). This provides a predictable ROI curve for investing in human data collection.

Hybrid Human-Robot Pretraining Unlocks Zero-Shot and In-Context Learning

By combining human video with 14.6k hours of robot data, the authors developed HumanWAM-Goal, which achieved state-of-the-art performance on RoboTwin 2.0 (92.70% Clean2Clean, 84.60% Clean2Random) (Abstract). More importantly, this hybrid approach enabled "emergent embodied in-context learning, dynamically adapting its manipulation behavior to unseen visual goals without parameter updates" (Abstract). This means a single pretrained policy can be deployed zero-shot to new tasks simply by showing it a picture of the desired outcome.

Data Diversity Outpaces Data Volume

The paper challenges the assumption that simply adding more hours of data is sufficient. Through controlled experiments, they show that "jointly scaling diversity and duration yields greater performance gains than scaling duration alone" (Section 3.3). Expanding task and scene coverage alongside duration produces steeper scaling curves, particularly benefiting out-of-distribution generalization.

Open-Source Full-Stack Release

Unlike many proprietary foundation models, the authors have open-sourced the entire stack: the Open-HumanWAM-50K corpus, data curation pipelines, pretrained and post-trained checkpoints, inference code, and simulation evaluation suites (Abstract). This lowers the barrier to entry for startups and researchers looking to build upon proven scaling recipes without reinventing the data curation wheel.

2. Contrarian Perspectives

Human Data Can Outperform Robot Data at Matched Scales

Most robotics companies assume that teleoperated robot data is inherently more valuable than human video because it matches the target embodiment. This paper argues otherwise. In Section 3.7, the authors state: "egocentric pretraining outperforms robot pretraining in all three settings from 500 to 5,000 hours." At 5,000 hours, human data achieved higher out-of-distribution success (52.3% vs. 45.6% on scene-OOD) than robot data. Furthermore, "The 1,000-hour egocentric model also outperforms the 5,000-hour robot model in all three settings." This suggests that the broader interaction coverage and scene diversity of human data outweigh the embodiment gap.

Multi-View Wrist Cameras Can Hurt Generalization if Introduced Naively

Robotics engineers often add wrist cameras to improve visibility for precise manipulation. However, the paper reveals a hidden trap: "introducing wrist-camera inputs directly during robot post-training can substantially damage the generalization benefits of egocentric pretraining" (Section 3.8). Under isolated attention, adding wrist views caused scene-OOD success to fall from 46.1% to 33.0–34.1%. The authors had to introduce a specific "mid-training" phase on human data with wrist views (EgoPro) to bridge the gap and preserve generalization.

Visual Goals Can Replace Fine-Tuning

The conventional wisdom in robotics is that every new task requires collecting demonstrations and fine-tuning the policy. HumanWAM-Goal demonstrates that visual goal conditioning can enable zero-shot execution. As noted in Section 5, "Because natural language instructions often leave object configurations, spatial relations, and terminal states underspecified, we augment our world-action model with explicit goal-image conditioning." This allows the model to execute unfamiliar tasks out-of-the-box by conditioning on a target image, bypassing the need for parameter updates.

3. Companies Identified

NVIDIA

Description: AI computing and foundation model company. Why relevant: The paper lists NVIDIA as an institutional affiliation. Additionally, the advanced HumanWAM-Goal model is built upon "the pretrained Cosmos3-Nano-16B backbone [38]" (Section 5.3), indicating reliance on NVIDIA's foundation model infrastructure. Quotes: "We build HumanWAM-Goal upon the pretrained Cosmos3-Nano-16B backbone [38]..."

Apple

Description: Consumer electronics and technology company. Why relevant: Apple's spatial computing hardware is used for data collection. The EgoDex dataset, which contributes 335 hours to the 50k corpus, was "Collected with Apple Vision Pro" (Section 2.1). Quotes: "Collected with Apple Vision Pro, it focuses on active manipulation of everyday objects..."

OpenAI

Description: AI research and deployment company. Why relevant: OpenAI's generative models are used to synthesize and review visual goals for robot training. The authors use "goal images synthesized by GPT Image 2.5 [40]" and review them using "ChatGPT Astra High [39]" (Section 5.4). Quotes: "...goal images synthesized by GPT Image 2.5 [40]. Each goal image is generated from the initial scene observation and task instruction using a fixed task-specific prompt..."

AgileX

Description: Robotics hardware manufacturer. Why relevant: The RoboTwin 2.0 benchmark and physical evaluations utilize the Aloha-AgileX embodiment, making it the target hardware platform for validating the policies. Quotes: "...a bimanual tabletop benchmark with 50 tasks on the Aloha-AgileX embodiment." (Section 3.1.3)

4. People Identified

Wojciech Matusik

Lab/Institution: MIT Why notable: A highly influential figure in computer graphics, computational fabrication, and physical AI. His involvement signals rigorous technical depth in the modeling and simulation aspects of this work. Quotes: Listed as an author in the institutional affiliations (PKU, NUS, MIT, UCSB, NVIDIA).

Tat-Seng Chua

Lab/Institution: NUS (National University of Singapore) Why notable: A leading researcher in multimedia and computer vision. His expertise supports the heavy emphasis on video processing, language annotation, and visual grounding in this paper. Quotes: Listed as an author in the institutional affiliations.

Daquan Zhou

Lab/Institution: PKU (Peking University) / NUS Why notable: The corresponding author of the paper, likely driving the strategic vision of the research. His focus on world-action models and scaling laws is directly relevant to the next generation of embodied foundation models. Quotes: Listed as the corresponding author (†Corresponding Author).

5. Operating Insights

Prioritize Data Diversity Over Pure Volume

For CTOs and heads of engineering building data collection pipelines, this paper offers a clear directive: do not just collect more of the same. The authors prove that "jointly scaling diversity and duration yields greater performance gains than scaling duration alone" (Section 3.3). When allocating budgets for teleoperation or human video collection, ensure you are expanding the breadth of tasks, scenes, and object interactions, as this yields a 61% steeper scaling slope than just adding redundant hours.

Leverage Human Video for Cost-Efficient Pretraining

Collecting robot data via teleoperation is expensive and slow. This paper provides strong evidence that human egocentric video is a superior pretraining modality at scale. As shown in Section 3.7, "The 1,000-hour egocentric model also outperforms the 5,000-hour robot model in all three settings." Operators should invest in pipelines to ingest, curate, and align human video data (e.g., from YouTube, head-mounted cameras) to pretrain their models, reserving costly robot teleoperation for fine-tuning and embodiment grounding.

Use Visual Goal Conditioning for Zero-Shot Deployment

If you are building general-purpose robots that need to perform new tasks in the field without retraining, visual goal conditioning is a proven mechanism. The paper demonstrates that HumanWAM-Goal can adapt its behavior to unseen visual goals without parameter updates (Abstract). Engineering teams should explore architectures that accept a target image as input alongside language, allowing end-users to simply show the robot a picture of what they want done.

6. Overlooked Insights

Cross-Source Action Alignment is Critical

When combining data from multiple sources (e.g., different human datasets, various robot platforms), raw action data can encode motions differently. The paper reveals that without explicit geometric alignment, pretraining suffers. In Section 3.5, the authors show that aligning camera frames and wrist axes improved out-of-distribution success from 43.2% to 52.2% compared to using raw actions. Teams merging datasets must invest in robust action alignment pipelines (standardizing coordinate frames, wrist axes, and gripper openness) or risk leaving significant performance on the table.

Metric Gripper Aperture for Cross-Embodiment Transfer

A subtle but crucial detail for cross-embodiment deployment is how gripper openness is represented. While many models normalize gripper states per-robot, this paper redefines gripper dimensions as "the absolute physical aperture in meters (0 denoting fully closed), normalized by a universal reference width of 0.12 m" (Section 5.2). For human data, they use the metric 3D distance between the thumb and index fingertips. This unified metric scale is what allows the model to transfer zero-shot to unseen robots without target-domain recalibration—a critical design choice for any multi-robot fleet.