XMimic and XSoma: Learning Humanoid Motion Tracking and Locomotion in Under a Minute
- 01Training-Loop Latency, Not GPU Compute, Is the Bottleneck for World-Model RL
- 02Humanoid Motion Tracking Training Compressed to Under a Minute
- 03World-Model Methods Now Beat the Fastest Model-Free Method on Locomotion
- 04Hybrid "Exact Where You Can, Learned Where You Must" World Models
- 05Better Final Quality, Not Just Faster
1. Key Themes
Training-Loop Latency, Not GPU Compute, Is the Bottleneck for World-Model RL
The core insight is diagnostic: world-model-based RL was slow not because GPUs lacked power, but because each iteration is a long sequential chain of tiny operations. The paper states: "BlinkMimic trains barely faster on an NVIDIA H100 than on an RTX 4090, as every training iteration is a long chain of small GPU operations that depend on each other... The time of such a chain is set by the number of its operations rather than by the compute of the GPU" (Section I). This is why throwing bigger hardware at the problem didn't help, and why the authors' fix was architectural (pipelining across GPUs) rather than brute-force.
Humanoid Motion Tracking Training Compressed to Under a Minute
XMimic learns a single policy to track all 40 LAFAN1 clips (about 2.5 hours of human motion retargeted to the Unitree G1) in 0.86 minutes on four H100s. The abstract and Section III.A put this at "3.7 times faster than BlinkMimic on one GPU." It was already "1.3 times faster on a single GPU" (Section I) thanks to compiling the whole loop in JAX and restructuring the policy update ("almost 40% faster than in a direct translation of BlinkMimic's code," Section II.A). For a team doing iterative whole-body control work, this changes the unit of experimentation from "run it overnight" to "run it during a coffee refill."
World-Model Methods Now Beat the Fastest Model-Free Method on Locomotion
Until now, "The fastest humanoid locomotion methods are still model-free, such as FastSAC... about 15 minutes on a single GPU. No method that learns with a world model has come close to this time" (Section I). XSoma reaches Holosoma's FastSAC tracking target in 0.77 minutes on four GPUs (12.3x faster) and still 3.8x faster on a single GPU (2.50 minutes vs. 9.44 minutes, Figure 4). It does so with "only an eighth of its environment steps" (Abstract), which matters wherever sample efficiency translates to cost (real-robot data, expensive simulators).
Hybrid "Exact Where You Can, Learned Where You Must" World Models
XSoma "leaves only the dynamics of the robot to the world model and computes everything else exactly, including the terrain height under the feet" (Abstract). Rewards, terminations, forward kinematics, and heightfield lookups are computed analytically on imagined states (Section II.C). The practical outcome: the policy "learns with a horizon of one second and without a critic," and the return is "calculated exactly as in Holosoma" using a straight-through estimator for termination gradients (Section II.C). This is a template for embedding known physics and task structure into learned models rather than learning everything.
Better Final Quality, Not Just Faster
Speed did not trade off against accuracy. "After 15 minutes, its velocity error... is a third lower than that of FastSAC on every number of GPUs," and "FastSAC does not reach this error even at the end of its complete schedule of about 50 minutes" (Section III.B). The authors attribute this to "the analytic gradient of the exact tracking reward."
2. Contrarian Perspectives
Don't Buy Bigger GPUs for Your Training Stack Until You've Profiled the Dependency Chain
Most robotics teams assume faster training means better hardware. The paper shows the opposite for this algorithm class: an H100 barely beats an RTX 4090 (Section I). The proposed remedy, "spreading each operation over more GPUs does not shorten it either" (Section I), runs against the instinct to shard everything. Instead, they pipeline different stages (collection, model update, policy update) across GPUs. The conventional "scale up the compute" playbook would have missed this.
Stale Data Is Fine: Asynchrony Costs Little
Conventional wisdom in RL says on-policy freshness matters, and teams often avoid asynchronous pipelines for fear of instability. The authors deliberately train with stale policies and world models: "the actor collects experience with a policy that is one iteration old, and the policy learns in a world model that is two iterations old" (Section II.B). The cost was small: "the older policy and world model cost only about 10% more iterations until the target" (Section III.A). In XSoma, applying consecutive stale gradients actually beat averaging: "these consecutive updates reached the target sooner than a single update with the averaged gradient of all learners" (Section II.B).
Critics Can Hurt; Skip Value Functions for Locomotion
Value functions are near-universal in RL pipelines. XSoma drops the critic entirely: "a critic, either to bootstrap the return at the horizon or for λ-returns, slowed the tracking down or destabilized the training" (Section II.C). The condition for this is that rewards and terminations are computed exactly and the horizon (48 steps, about one second) is long enough. Most teams would not try this; the paper suggests the critic is a liability when you have exact task structure.
3. Companies Identified
NVIDIA
GPU vendor. H100 GPUs are the experimental platform for every result. Also co-developer of the simulator. Why relevant: The paper reframes NVIDIA's hardware value: more H100s help only if software is restructured to exploit them. Quote: "BlinkMimic trains barely faster on an NVIDIA H100 than on an RTX 4090" (Section I); "train every method on NVIDIA H100 GPUs of the same cluster" (Section III). The authors also list MuJoCo Warp as "Google DeepMind and NVIDIA" (ref. [17]).
Google DeepMind
Co-developer of MuJoCo Warp and creator of JAX (via Google authors). Why relevant: The entire training loop depends on JAX and MuJoCo Warp via MJX. Quote: "We compile the complete training loop with JAX, including the MuJoCo Warp simulator" (Abstract). Ecosystem leverage accrues to the JAX/MuJoCo stack.
Unitree Robotics
Maker of the G1 humanoid. Why relevant: Sole robot platform used and the default benchmark humanoid for open research. Quote: "XMimic learns to track all 40 LAFAN1 clips with the Unitree G1 in 0.86 minutes" (Abstract). Note: results are simulation only; no hardware deployment yet.
Amazon FAR (Frontier AI & Robotics)
Developer of Holosoma, the humanoid locomotion framework and benchmark, and co-author group of FastSAC. Why relevant: Holosoma defines the task, targets, reward coefficients, and robot model XSoma is evaluated against. Quote: "XSoma reaches the tracking target that Holosoma's tests set for FastSAC in 0.77 minutes" (Abstract). Amazon FAR's tooling is becoming a de facto benchmark standard.
Open-Source Community Projects: BlinkMimic, InstantTrack
Not companies, but GitHub-based community projects that form the actual baseline. Why relevant: Competitive baselines are individual open-source implementations. Quote: "InstantTrack [10] and BlinkMimic [11] then reduced the time to learn all 40 clips of the LAFAN1 dataset on the Unitree G1 to about 3 minutes on a single consumer GPU, down from about 1.5 hours" (Section I).
Compute Infrastructure Providers (EuroHPC / LuxProvide / NAISS / NHR)
Public supercomputing programs that funded the work. Why relevant: The work ran on academic HPC rather than private cloud, which suggests frontier-speed experimentation is accessible without big-lab budgets. See the Acknowledgment section for the list (MeluXina, Vega, Arrhenius, Lichtenberg II, Otus, Noctua 2).
4. People Identified
Nico Bohlinger
Technical University of Darmstadt (Dept. of Computer Science). Why notable: First author and corresponding author; also author of RL-X, a JAX-oriented RL library (ref. [21]). The paper builds on his prior tooling. Quote: "Corresponding author: nico.bohlinger@tu-darmstadt.de"; cites "RL-X: A deep reinforcement learning library (not only) for RoboCup" (ref. [21]).
Jan Peters
TU Darmstadt; Robotics Institute Germany (RIG); German Research Center for AI (DFKI); hessian.AI. Why notable: Senior author, one of the best-known figures in robot learning in Europe. Affiliation list: "Department of Computer Science, Technical University of Darmstadt... Robotics Institute Germany (RIG); German Research Center for AI (DFKI); hessian.AI."
Qiayuan Liao and Koushil Sreenath (and collaborators)
Cited for SuperMimic [5] and BeyondMimic [1]; Sreenath is a Berkeley-affiliated roboticist. Why notable: SuperMimic is the foundational algorithm. Quote: "SuperMimic [5] showed that motion tracking can be learned with far less compute when the policy is optimized through a learned world model instead of with model-free RL" (Section I).
Pieter Abbeel and the Amazon FAR / FastSAC Team (Younggyo Seo, Carmelo Sferrazza, et al.)
Why notable: Authors of FastSAC ("Learning sim-to-real humanoid locomotion in 15 minutes," ref. [2]) and Holosoma [3], the state-of-the-art model-free baseline XSoma beats. Abbeel is also a co-author on SuperMimic [5].
Marco Heyrman and Marco Hutter
ETH Zurich (Robotic Systems Lab / leggedrobotics). Why notable: Authors of Terrain-Grounded Imagination [14], whose heightfield lookup technique XSoma adopts. Quote: TGI "trained a humanoid policy through a world model to walk over stairs and gaps, using exact heightfield lookups for the terrain in its rollouts, but its training takes hours" (Section I). Hutter is also an author of the foundational minutes-scale GPU locomotion paper [4] (Rudin et al.).
Jungdam Won, Intae Choi, Gyeonghun Leem
Seoul National University (per reference [15]; affiliation inferred from the author list as not stated in the text). Why notable: Authors of InstantMimic [15], whose approach of keeping "the complete training loop on the GPU" XSoma and XMimic follow (Section I).
Danijar Hafner
Author of Dreamer [8]. Why notable: Dreamer is cited as part of the lineage of learning behaviors through imagined rollouts in a world model (Section I).
5. Operating Insights
Profile Your Training Loop for Latency, Not Just Throughput
If your team runs differentiable or world-model RL, check whether your iteration is bound by the number of sequential kernel launches. The paper's own diagnostic is a clear model: a single-GPU iteration takes T1 = Tc + Tw + Tp, and pipelining brings it to roughly max(Tc, Tw, Tp) (Equation 2, Section II.B). Actionable steps from the paper include compiling the whole loop (JAX/XLA), hoisting computations independent of imagined states out of the rollout, and using fewer, larger matrix multiplications in the backward pass. These alone gave "almost 40%" faster policy updates (Section II.A). Note the caveat: compile time is non-trivial: "start-up and compilation take 20 to 40 seconds when the compiled programs are cached and up to about 3 minutes otherwise" (Section III). Cache your compiled programs.
Treat Minute-Scale Training as a Workflow Change, and Plan for the Next Bottleneck
When a full retraining takes under a minute, reward tuning, curriculum design, ablations, and per-clip fixes become interactive. But the authors flag where the wall moves next: "On four GPUs, the actor is now the bottleneck of XMimic and XSoma, so we will spread its data collection across more GPUs" (Section IV). For a CTO, that means simulation throughput becomes the next constraint, so simulator selection (MuJoCo Warp here) and contact-constraint settings matter. The authors note XMimic "allows fewer contact constraints per environment, which is slightly faster and rarely limiting" (Section III.A), a sim-fidelity trade-off worth auditing.
Design the Task So the Simulator-Independent Parts Are Computable in Closed Form
XSoma's recipe requires that rewards, terminations, kinematics, and terrain be exactly computable from imagined states. That worked for velocity tracking on heightfield terrain. If your product's task has exact, differentiable structure, this approach is attractive. Also note practical stabilizers: running half the environments with deterministic actions was necessary. Without it, "after about 45 minutes, the deterministic policy sank into a crouch and fell in up to 61% of the evaluation episodes" (Section II.C).
6. Overlooked Insights
Everything Here Is Simulation-Only, and the Terrain Is Mild
The headline "under a minute" is a sim-training time. The conclusion states plainly: "So far, we have only trained and evaluated the policies in simulation. In future work, we will deploy them on the real G1 and also extend XSoma to more challenging terrain" (Section IV). The terrain has "height differences of a few centimeters" (Section III.B), which is far from stairs or gaps. The world model's exact heightfield lookup is also an advantage that real-world perception wouldn't provide: real robots must estimate terrain, which this setup sidesteps. Discount the speedup's relevance to deployment until sim-to-real results exist, and note that the reported time also excludes compilation, which is subtracted for baselines as well ("which we also subtract from the times of the baselines," Section III).
Speed Isn't Free in Compute or Fairness: Four GPUs Cost More GPU-Time, and Baselines Differ in Hardware Assumptions
The 3.7x and 12.3x numbers compare four-GPU runs to single-GPU baselines. The paper is candid on the first: "Together, the four GPUs use slightly more GPU time than BlinkMimic on its single GPU, so the split trades a little compute for a much shorter training time" (Section III.A). So the gain is wall-clock, not efficiency per dollar. The single-GPU comparison is the more cost-neutral figure (1.3x for XMimic; 3.8x for XSoma). Also notable: XSoma's own PPO comparison is held to a stricter target than Holosoma's own PPO test uses ("We hold PPO to the same target, although Holosoma's own test for PPO sets a lower one," Section III.B), and PPO "does not reach it within the first hour." That PPO result should be read as target-specific, not as proof PPO fails at the task. Finally, sample sizes are small (e.g., InstantTrack has two runs, per the Figure 3 caption), so treat tight comparisons cautiously.