Learning Terrain-Adaptive Humanoid Locomotion on Granular Terrain

1. Key Themes

Physics-Grounded Simulation for Sim-to-Real Transfer on Deformable Terrain

The paper's core technical contribution is the integration of a three-dimensional resistive force theory (3D RFT) contact model into a reinforcement learning (RL) training pipeline. Standard robotics simulators use rigid contact models, which fail to capture how a robot's foot sinks and slips in sand or gravel. By using a physics-grounded model that captures realistic penetration and tangential drag, the trained policies can reliably transfer to real-world granular terrain. As the authors state in the Abstract: "Unlike traditional rigid contact models and simplified granular contact models with ad-hoc heuristics, our contact solver produces physically accurate granular intrusion dynamics without resorting to heuristics."

Terrain-Adaptive Locomotion via Teacher-Student RL

The system learns to adapt its walking style to different terrain types (e.g., hard basalt vs. soft sand) without requiring external sensors like cameras or LiDAR. It uses a "teacher-student" framework where the teacher trains with privileged information (ground-truth terrain stiffness) compressed into a compact latent representation via a variational autoencoder (VAE). A deployable "student" policy is then trained to infer this terrain stiffness purely from its own movement history (proprioception). The authors note in Section IV.A: "The student has no decoder of its own and reuses the teacher’s fixed decoder during training... steering the latent representation specifically toward terrain material properties."

First Real-World Agile Humanoid Locomotion on Granular Media

The researchers validate their approach on a physical Unitree G1 humanoid robot, demonstrating walking, running, and jumping on basalt, dry sand, and beach sand. This is a significant milestone for physical AI, as humanoid robots have historically struggled with non-rigid surfaces. The authors claim in the Abstract: "To the best of our knowledge, this is the first demonstration of agile humanoid locomotion on real-world granular terrain."

Dynamic Gait Adaptation Based on Inferred Terrain Softness

The learned policy doesn't just survive on soft terrain; it actively changes its gait geometry to do so. The system dynamically adjusts its swing foot clearance (how high it lifts its feet) and gait frequency based on the inferred terrain stiffness. In Section I, the authors list as a key contribution: "A terrain-adaptive locomotion policy that produces adaptive swing foot clearance and gait frequency under changing terrain stiffness."

2. Contrarian Perspectives

Domain Randomization is Not Enough for Complex Terrains

A common strategy in the robotics industry is to bridge the sim-to-real gap by randomly varying parameters (domain randomization) in a rigid-body simulator, hoping the policy becomes robust to any condition. This paper argues that for deformable terrain, this approach is insufficient. Explicitly modeling the physics of the terrain yields far better results. In Section V.A, the authors note: "While domain randomization helps improve the performance of Heuristic-RFT and Cone-RFT-Multi policies, it is not sufficient to match the performance of 3D-RFT under difficult terrain conditions."

Heuristic Friction Models Fail in Lateral Directions

Prior work attempting to model granular terrain for RL typically uses a normal force model and supplements it with heuristic friction models (like Coulomb friction) for tangential forces. The paper demonstrates that these heuristics fail to capture lateral forces, which are crucial for stabilization when a foot slips sideways. In Section V.A, the authors explain: "In the lateral direction, Heuristic-RFT produces no force response, as its Coulomb-type tangential component acts only along the slip direction within the sagittal plane. In contrast, the lateral force response of our model emerges naturally from the 3D RFT formulation rather than from a heuristically designed tangential model."

3. Companies Identified

NVIDIA

• Description: GPU manufacturer and developer of physics simulation frameworks.
• Why relevant: The research heavily relies on NVIDIA's software stack. The team uses IsaacLab for RL training, NVIDIA Warp for the soft contact model implementation, and NVIDIA Newton's Material Point Method (MPM) solver for high-fidelity validation. As stated in Section IV.B: "We implement the soft contact model with NVIDIA Warp [35], enabling simulation at hundreds of thousands of frames per second on a single RTX 4090 GPU."
• Quotes: "Simulation studies using material point method (MPM) with NVIDIA Newton demonstrate that our method generalizes to unseen granular terrains..." (Abstract)

Unitree

• Description: Manufacturer of legged and humanoid robots.
• Why relevant: The hardware experiments were deployed on the Unitree G1 humanoid robot, proving the framework works on a commercially available, full-scale humanoid platform.
• Quotes: "We deploy the trained RL policy on a Unitree G1 humanoid robot to validate our approach in real world." (Section V.B)

Google DeepMind

• Description: AI research lab and developer of robotics simulation tools.
• Why relevant: Co-developed MuJoCo Warp, which was used to handle the robot's whole-body and rigid contact dynamics during evaluation.
• Quotes: "MuJoCo Warp [16] handles the robot’s whole-body and rigid contact dynamics, while the MPM solver computes contact forces on deformable sand." (Section V.A)

4. People Identified

Daniel I. Goldman

• Lab/Institution: School of Physics, Georgia Institute of Technology
• Why notable: Goldman is a leading expert in the physics of locomotion on granular media. His foundational work on Resistive Force Theory (RFT) is the basis for the contact model used in this paper. His involvement signals strong physics grounding for the sim-to-real approach.
• Quotes: "Model-based approaches tackle granular terrain through terradynamics, most notably resistive force theory (RFT) [11]–[13]..." (Section I)

Ye Zhao

• Lab/Institution: Institute for Robotics and Intelligent Machines, Georgia Institute of Technology
• Why notable: Senior author of the paper, leading research in humanoid locomotion and control. His lab focuses on bridging dynamic control and learning for physical AI systems.
• Quotes: (Listed as the corresponding author and senior researcher overseeing the project).

Seth Hutchinson

• Lab/Institution: Northeastern University
• Why notable: A highly prominent figure in robotics (former editor-in-chief of IEEE Transactions on Robotics). His involvement highlights the control-theoretic rigor of the work.
• Quotes: (Co-author, contributing to the control and system design aspects).

5. Operating Insights

Sim-to-Real Requires Physics-Aware Contact Models for Deformable Surfaces

If you are deploying legged or humanoid robots outdoors on sand, gravel, mud, or loose soil, standard rigid-body simulators will fail at higher speeds. CTOs and heads of engineering should invest in integrating reduced-order physics models (like 3D RFT) into their RL training pipelines rather than just throwing more domain randomization at the problem. The paper shows that rigid-contact policies fail completely on soft sand and basalt at higher speeds. As noted in Section V.B: "At higher speeds (≥1.5 m/s), Rigid experiences substantial degradation in performance due to increased perturbations to the foot, and fails to walk above 1.5 m/s."

Proprioceptive Terrain Estimation Enables Compliant, Energy-Efficient Control

By using a VAE to compress terrain properties into a latent space, the robot can infer ground softness purely from its own joint history, without needing external sensors. This leads to more compliant, less damaging gaits that reduce wear and tear on the hardware. Operators should look for architectures that estimate terrain properties as an auxiliary task. The authors found in Section V.B: "Our policy shows a lower peak ankle pitch torque than Rigid and 3D-RFT on both legs, indicating compliant ankle control that minimizes terrain disturbance."

6. Overlooked Insights

Simulation Speed and Cost Trade-offs

The paper highlights a practical pipeline for robotics companies: use fast, approximate physics models for RL training, and high-fidelity models for validation. High-fidelity particle methods like the Discrete Element Method (DEM) or Material Point Method (MPM) are too computationally expensive for training thousands of parallel agents. The authors use 3D RFT for training because it is fast, and use MPM only for evaluation. As stated in Section II.A: "Since RFT retains an analytical structure with parameters fit from intrusion experiments, it is a middle ground between simplified contact models and high-fidelity particle-based models." Furthermore, they note in Section IV.B that their implementation enables "simulation at hundreds of thousands of frames per second on a single RTX 4090 GPU."

Foot Clearance Adaptation is a Key Observable Behavioral Output

The terrain encoder doesn't just make the robot walk more stably; it actively changes the gait geometry in a way that is directly observable. On soft sand, the robot lifts its foot significantly higher (up to 16 cm vs. a 9 cm nominal height) to avoid dragging it into the ground. This provides a clear, visual metric for operators to verify that the terrain adaptation system is functioning correctly in the field. In Section V.C, the authors note: "swing foot clearance stays near its nominal value of 9 cm on stiff terrain and rises up to 16 cm on softer terrain to avoid dragging the foot into the ground."