Demystifying When and… | arXiv Physical AI Research Summary

1. Key Themes

Contact-Rich Manipulation Failures Decompose into Two Causally Independent Modes

The paper's core contribution is a principled decomposition of why VLA models fail at contact-rich tasks into two distinct root causes: precision failures (the flow-matching training schedule starves the low-noise denoising regime where sub-millimeter corrections happen) and force failures (force signals have structural properties—sparsity, temporal dynamics, sensitivity modulation—that naive fusion ignores). This matters because it means the field has been conflating two different problems. As the paper states: "Precision failures occur because flow-matching training starves the low-noise denoising regime where contact demands small, accurate corrective actions. Force failures occur because force signals contain informative dynamics that are not captured when force is treated as just another input stream" (Section 1).

A Free Fix: Replacing the Noise Schedule Yields Major Gains with Zero Added Parameters

The Logit-Normal (LN) noise schedule is a drop-in replacement for the Beta schedule used in π0, π0.5, and SmolVLA that reallocates 6× more gradient signal to the contact-correction regime (τ < 0.2). This requires "no changes to the model architecture, no additional training data, and no extra parameters, making it directly applicable to any flow-matching VLA" (Section 5.1). On plug insertion alone, this single change improved success from 30% to 50% (+20pp), and on button push from 12.5% to 57.5% (+45pp, p<.001) (Table 1). This is arguably the highest-ROI intervention in the paper for anyone already deploying flow-based VLAs.

Force Signals Need Architectural Respect, Not Naive Concatenation

The time-aware force injection mechanism addresses three structural properties of force: contact sparsity (force is ~zero most of the time, biasing gradients to ignore it), temporal structure (recent history encodes contact dynamics), and sensitivity modulation (force should modulate policy responsiveness, not just augment it). The ablation in Table 3 shows force history is the most critical component—removing it drops button push by 62.5pp and key insertion by 40pp. The gradient gate (blocking gradients through force encoders when no contact is detected) is also essential, confirming that naive force fusion actively harms learning.

FACT Outperforms Force-Augmented VLAs by 25+ Percentage Points

Across five contact-rich tasks and ~2,500 real-world rollouts, FACT achieves 66% average success vs. 41% for ForceVLA and 37.5% for TA-VLA (Table 1). The gains are consistent across both precision-critical tasks (plug insertion: 57.5% vs 32.5% for ForceVLA) and force-critical tasks (key insertion: 60% vs 42.5% for ForceVLA). The noise-substitution ablation (Table A.1) confirms these gains reflect genuine force exploitation—replacing F/T readings with Gaussian noise collapses FACT's performance on force-critical tasks (key insertion drops from 60% to 5%), while TA-VLA shows "no meaningful dependence on F/T," suggesting its architecture doesn't reliably extract force information.

Solutions Transfer Across VLA Backbones

FACT was validated on both π0.5 and π0 backbones. FACTπ0 achieves 70% on plug insertion, 50% on key insertion, and 60% on button push, outperforming both baselines on π0 (Table 4). Interestingly, π0.5 outperforms π0 on force-critical tasks by >10pp while π0 outperforms π0.5 on precision-critical tasks by 12.5pp, suggesting backbone choice should be task-dependent (Section 7).

2. Contrarian Perspectives

The Contact-Rich Gap Is Not Primarily a Sensing Problem

Most robotics companies and researchers frame contact-rich manipulation failures as a force-sensing problem—add a force/torque sensor, fuse it with vision, and you're done. This paper argues that framing is incomplete and potentially misleading. The authors state: "they frame the contact-rich manipulation gap primarily as a force-sensing problem, leaving unexamined whether failures could stem from the training procedure itself rather than from missing sensory modalities" (Section 1). The evidence: on precision-critical tasks (plug and USB insertion), adding force feedback provides "no statistically significant benefit"—these tasks fail because of training schedule imbalance, not missing force data (Section 7). A company spending millions on tactile sensors and force fusion modules for precision assembly might be solving the wrong problem.

More Force Architecture Is Not Better—Less Is More

ForceVLA adds ~45M parameters (a LIMoE routing block) for force integration. FACT adds ~2.2M. TA-VLA adds ~2.1M. Despite ForceVLA's 20× larger parameter budget for force modules, FACT outperforms it across all tasks. The paper's noise-substitution ablation reveals that ForceVLA only genuinely exploits force on one task (key insertion), while TA-VLA shows no meaningful force dependence at all (Table A.1). The insight: the force integration problem is about how you inject force signals (respecting their sparsity, temporal structure, and contact-gated sensitivity), not how many parameters you throw at it.

Standard VLA Noise Schedules Are Actively Harming Contact Performance

The Beta(1.5, 1.0) schedule used in π0, π0.5, and SmolVLA allocates only 8.9% of gradient signal to τ < 0.2—the regime that governs fine corrective actions during contact (Section 4.1, Figure 3a). This means every team fine-tuning these models for contact-rich tasks is systematically under-training the exact behavior they need. The fix is a one-line code change in the noise scheduler, and it works as a drop-in improvement for existing force-augmented baselines too (Table 2 shows LN improves TA-VLA and ForceVLA by 17.5-22.5pp).

3. Companies Identified

Physical Intelligence (π0, π0.5)

Description: Developer of π0 and π0.5, flow-matching VLA models that are among the most widely used generalist robot policies.
Why relevant: Their Beta noise schedule is identified as a key bottleneck for contact-rich tasks. The paper shows their default schedule starves the contact-correction regime. FACT's LN fix works as a drop-in on their backbones, meaning any team using π0/π0.5 for assembly or insertion tasks should immediately adopt it.
Quote: "commonly used Beta noise schedules in VLAs such as π0 [1], π0.5 [2], and SmolVLA [6] allocate only 8.9% of gradient signal to τ < 0.2" (Section 4.1).

Hugging Face / Inria (SmolVLA)

Description: Developers of SmolVLA, an open-source affordable VLA model.
Why relevant: SmolVLA uses the same Beta noise schedule identified as problematic, suggesting the LN fix applies broadly across the open-source VLA ecosystem.
Quote: Referenced in Section 4.1 alongside π0 and π0.5 as using the problematic Beta schedule.

NVIDIA (GR00T N1)

Description: Developer of GR00T N1, an open foundation model for generalist humanoid robots.
Why relevant: Referenced as a VLA model in the general manipulation landscape (Reference [4]). While not directly evaluated in this paper, the LN noise schedule fix would likely apply if GR00T uses flow-matching training.

Google DeepMind (RT-2)

Description: Developer of RT-2, a vision-language-action model transferring web knowledge to robotic control.
Why relevant: Referenced as a foundational VLA model (Reference [3]). The paper's diagnosis of contact-rich failures applies to the broader VLA paradigm RT-2 represents.

Bota Systems (Bota SensONE)

Description: Manufacturer of the 6-axis force/torque sensor used in all experiments.
Why relevant: The sensor is the hardware enabling force feedback across all methods tested. The paper validates that wrist-mounted F/T sensing at 400 Hz, when properly integrated, is sufficient for contact-rich tasks—no fingertip tactile sensors required.
Quote: "All experiments are conducted on a single Franka Research 3 arm equipped with a wrist-mounted Bota SensONE 6-axis force/torque (F/T) sensor" (Appendix B).

Haply Robotics (Inverse 3)

Description: Manufacturer of the haptic device used for teleoperated data collection.
Why relevant: The Inverse 3 provides force feedback to the operator during demonstration collection, which may improve the quality of contact-rich demonstrations. All 100 demonstrations per task were collected this way.
Quote: "For each task, we collect 100 teleoperated demonstrations using a Haply Inverse 3 haptic device that provides force feedback to the operator" (Section 6).

Franka Robotics (Franka Research 3)

Description: Manufacturer of the robot arm used in all experiments.
Why relevant: The FR3 is the standard research robot; results are validated on this platform. The paper notes generalization to other kinematic structures remains open (Limitations).

Robotiq

Description: Manufacturer of the gripper used in experiments.
Why relevant: The gripper is part of the hardware setup; the wrist-mounted F/T sensor sits between the robot wrist and the Robotiq gripper (Appendix B, Figure A.2).

4. People Identified

Jeannette Bohg

Lab/Institution: Stanford University, Intelligent and Physical Robotics Lab (IPRL)
Why notable: Senior author and PI. Bohg is one of the most influential researchers in contact-rich manipulation and multimodal sensing, with foundational work on vision-force fusion (e.g., "Making Sense of Vision and Touch," IEEE TRO 2020). Her lab consistently produces work that bridges learning and classical control for manipulation.
Quote: Senior author; the paper is hosted at https://stanford-iprl-lab.github.io/fact/

Carlota Parés-Morlans

Lab/Institution: Stanford University, IPRL Lab; Knight-Hennessy Scholar
Why notable: Lead author and presumably lead contributor. Knight-Hennessy Scholars represent Stanford's top doctoral talent. Working on the intersection of VLA models and contact-rich manipulation—a critical gap for commercial deployment.
Quote: "Carlota Parés-Morlans is supported by a graduate fellowship from Knight-Hennessy Scholars at Stanford University" (Acknowledgments).

Alberta Longhini

Lab/Institution: Stanford University, IPRL Lab; Wallenberg–Bienenstock Postdoctoral Fellow
Why notable: Postdoctoral researcher at a top manipulation lab. The Wallenberg–Bienenstock fellowship is highly prestigious, indicating strong selection.
Quote: "Alberta Longhini is supported by a Wallenberg–Bienenstock Postdoctoral Fellowship" (Acknowledgments).

5. Operating Insights

Audit Your Noise Schedule Before Adding Sensors or Parameters

If your team is fine-tuning a flow-matching VLA (π0, π0.5, SmolVLA, or similar) for any task involving contact—insertion, assembly, pressing, wiping—check your noise schedule first. The default Beta schedule allocates only 8.9% of training signal to the regime governing sub-millimeter corrections. Switching to the Logit-Normal schedule with m=1.5 is a one-line change that yielded +20pp on plug insertion and +45pp on button push with "no additional data, no extra parameters, and no architectural changes" (Section 5.1). The parameter sweep in Figure A.3 shows performance rises sharply once sufficient signal reaches τ < 0.2, and the optimal m=1.5 is consistent. This should be the first intervention, before investing in force sensors or new architectures.

Force Integration Design Matters More Than Force Sensor Selection

If you're adding force/torque sensing to your robot stack, the architectural choices for how force enters the policy are more impactful than the sensor itself. The paper shows that a simple wrist-mounted F/T sensor (Bota SensONE, ~$1-2K) with proper integration (contact-gated gradients, 2-second temporal history, sensitivity modulation via AdaRMS) outperforms architectures with 20× more force-related parameters (ForceVLA's 45M LIMoE block). Specifically: (1) use a gradient gate to block force encoder gradients when no contact is detected, (2) maintain ~2 seconds of force history via a causal encoder, and (3) inject current force readings into normalization layers to modulate layer-wise sensitivity rather than concatenating as another input token (Section 5.2, Table 3, Table A.2).

Choose Your VLA Backbone Based on Task Type

The paper reveals that π0.5 outperforms π0 on force-critical tasks by >10pp, while π0 outperforms π0.5 on precision-critical tasks by 12.5pp (Section 7, Table 4 comparison). The authors hypothesize π0.5's explicit timestep conditioning makes force injection more effective, while π0's pretraining or state representation may better support fine corrections. If you're deploying robots for force-driven tasks (button pressing, key insertion, probing), π0.5 + FACT is the better stack. For precision-driven tasks (connector insertion, USB insertion), π0 + FACT may be preferable.

6. Overlooked Insights

100 Demonstrations Per Task Is Sufficient—But Only With the Right Training Setup

Each task used only 100 teleoperated demonstrations, and FACT still achieved 57.5-75% success on the hardest tasks. This is a remarkably small dataset for contact-rich manipulation, suggesting that the bottleneck has been training methodology, not data quantity. Companies struggling with data collection costs for assembly tasks should consider whether their training pipeline (noise schedule, force integration) is the limiting factor before scaling up demonstration collection. The paper also notes all methods were "fine-tuned from the pre-trained π0.5 checkpoint using LoRA for 20,000 steps"—suggesting pretraining + LoRA fine-tuning is the efficient path, not training from scratch (Section 6).

The Controller Architecture Is Doing Heavy Lifting That VLAs Get Credit For

Board erasing achieved near-perfect success (87.5-100%) across ALL methods including the baseline π0.5 without any force augmentation. The paper attributes this to "the compliant operational-space controller" which "maintains consistent contact force without requiring explicit force reasoning from the policy" (Section 7). This means for tasks involving sustained surface contact (wiping, sanding, polishing), a well-tuned impedance controller may eliminate the need for force-aware policies entirely. The VLA's job is to generate the trajectory; the controller handles force regulation. This has significant implications for which tasks actually need force-augmented VLAs versus just better low-level control. The full controller design (trajectory interpolation at 1 kHz, Cartesian impedance PD control, operational-space torque computation) is detailed in Appendix C and represents a production-ready architecture for contact-rich deployment.