DSWAM: A Dual-System… | arXiv Physical AI Research Summary

1. Key Themes

WAM Execution Outperforms VLA Policies Under Controlled, Apples-to-Apples Comparison

The paper's central empirical claim is that World Action Model (WAM) execution — which uses video-based world modeling as training supervision — outperforms Vision-Language-Action (VLA) policies when compared under matched conditions (same robot, same data, same task protocol, same success criteria). On the real-world folding benchmark, DSWAM achieves 96.3% average success rate versus DeMaVLA's 92.5%, while reducing completion time from 2'18" to 1'44" (Section 4.3, Table 2). The most dramatic improvement is on pants folding: success rate jumps from 75.0% to 90.0% and completion time drops from 3'01" to 2'19". This matters because the robotics field has lacked fair head-to-head comparisons between WAM and VLA approaches — most comparisons are confounded by differences in data, embodiment, or evaluation protocol.

Decoupling Semantic Planning from Physical Execution via a Dual-System Architecture

DSWAM introduces a Kahneman-style dual-system design: System 1 is a WAM executor that handles physical manipulation by default, and System 2 is an optional vision-language subtask planner that activates only when a coarse instruction needs decomposition into fine-grained subtasks. The paper states: "This avoids making planning mandatory for atomic instructions or tasks that the WAM executor already solves reliably, while still supporting coarse commands that require structured subtask execution" (Section 1). The System 2 planner is a Rynnbrain4B-style VLM that takes 5 frames of visual history at 1 Hz and predicts the next executable subtask instruction (Section 3.2). This is architecturally significant because it avoids the latency and complexity penalty of always-on planning.

Training-Time World Modeling Without Test-Time Video Generation

A key insight: the benefit of world modeling comes from training-time supervision, not test-time future imagination. The executor is trained with a shared flow-matching objective over both action chunks and future latent visual tokens (Section 3.3.1, Equations 12-15), but at inference time, "No future frames are sampled, denoised, or decoded" (Section 3.3.1). This eliminates the expensive video generation step that has made WAMs impractical for real-time control, while retaining the physical dynamics understanding learned during training. This follows the direction suggested by Fast-WAM and GigaWorld-Policy (Section 2.3).

Engineering for Real-Robot Deployment: TensorRT + Asynchronous RTC

The paper demonstrates a production-grade deployment stack. By splitting the model into two TensorRT engines (a visual-context engine and an action-denoising engine), they achieve 2.69× speedup (198.2ms → 73.8ms) on an RTX 5090 with BF16 precision, while maintaining 0.99977 cosine similarity to the PyTorch reference (Section 4.5, Table 4). Combined with asynchronous real-time chunking (RTC), where a policy worker predicts new chunks while the controller executes the current chunk, they show that decoupling policy inference from robot control improves execution stability — pants folding success went from 70% (synchronous) to 100% (asynchronous RTC) on easy garment instances (Table 5).

Subtask Supervision Dramatically Reduces Execution Errors

When coarse instructions are decomposed into subtask-level instructions, the system achieves 100% success rate on a sorting task versus 75.7% with raw instructions, and execution mistakes per rollout drop from 3.53 to 0.65 (Section 4.4, Table 3). Notably, subtask-level supervision reaches 100% success at only 6,000 training steps, while raw instruction training still only achieves 80% at 18,000 steps — suggesting that structured task decomposition also improves sample efficiency.

2. Contrarian Perspectives

WAMs Don't Need Test-Time Video Generation — The Value Is in Training Supervision

The prevailing assumption in the world model community is that generating future video at inference time provides useful "visual foresight" that improves action selection. DSWAM argues the opposite: "the main benefit of WAMs can come from training-time world-modeling supervision rather than test-time future imagination" (Section 2.3). By dropping explicit future video generation at inference, they eliminate a major source of latency while retaining performance gains. This challenges companies building imagine-then-execute WAM pipelines to reconsider whether the inference cost of video generation is justified.

Planning Should Be Optional, Not Always-On

Many robotics architectures treat high-level planning as a mandatory step in every control cycle. DSWAM's design philosophy is that "semantic task organization and world-aware physical execution can be decoupled" (Section 1), and that planning should only be invoked "when task decomposition is useful." In the real-world folding benchmark, the System 2 planner is deliberately disabled to show that the WAM executor alone can outperform VLA policies. This challenges the trend of building monolithic VLA models that attempt to handle both semantic reasoning and low-level control in a single forward pass.

VLA Policies May Be Fundamentally Limited by Their Observation-to-Action Formulation

The paper makes a pointed critique of VLA policies: "most VLA policies are still trained mainly as direct observation-and-language-to-action mappings, so their supervision for how the physical scene evolves under robot intervention is indirect compared with video-based world modeling" (Section 2.1). This suggests that the VLA paradigm — which dominates current commercial robotics — may have a structural ceiling on contact-rich manipulation tasks because it lacks dense temporal supervision of physical dynamics.

3. Companies Identified

Physical Intelligence (π₀, π₀.₅)

Description: Leading VLA robotics company; creators of π₀ and π₀.₅ vision-language-action models.
Why relevant: π₀ and π₀.₅ are used as baselines in both the RoboTwin 2.0 simulation benchmark and the real-world folding benchmark. DSWAM outperforms π₀ by 20 percentage points on real-world folding (76.3% → 96.3%) and by 9.64-15.14 percentage points on RoboTwin 2.0 (Section 4.2-4.3, Tables 1-2). This positions WAM-style approaches as a credible alternative to Physical Intelligence's VLA paradigm.
Quote: "Relative to π₀, it improves average SR by 20.0 percentage points and reduces average completion time by 42 seconds" (Section 4.3).

NVIDIA (Cosmos Policy, TensorRT, RTX 5090)

Description: GPU and AI infrastructure company; Cosmos Policy is their video-foundation-model-based robot policy.
Why relevant: DSWAM uses NVIDIA's TensorRT for inference acceleration and runs on an RTX 5090. Cosmos Policy is cited as a related WAM approach. The deployment stack (BF16 TensorRT, CUDA 12.9) is NVIDIA-centric, indicating that real-time WAM deployment is tightly coupled to NVIDIA's hardware/software ecosystem.
Quote: "BF16 TensorRT reduces warmed end-to-end policy latency from 198.2 ms in PyTorch to 73.8 ms on an NVIDIA GeForce RTX 5090 with CUDA 12.9 and TensorRT 10.16.1" (Section 4.5, Table 4).

Midea Group (AIRC)

Description: Chinese home appliance and consumer electronics multinational; the paper's authors are from AIRC, Midea Group and Tongji University.
Why relevant: Midea is the corporate backing behind this research, signaling that a major appliance manufacturer is investing in WAM-based manipulation for household tasks. The focus on deformable manipulation (folding clothes) aligns with home robotics applications.
Quote: Authors are affiliated with "AIRC, Midea Group" (author affiliations).

4. People Identified

Jian Zhu (AIRC, Midea Group / Tongji University)

Why notable: Lead author and corresponding author of DSWAM. Also an author on DeMaVLA (the VLA baseline used for matched comparison), giving him deep expertise in both VLA and WAM paradigms.
Quote: Co-authored both DSWAM and DeMaVLA [22], enabling the controlled comparison that is this paper's key contribution.

Yi Xu (AIRC, Midea Group)

Why notable: Corresponding author and project leader. Affiliated with Midea Group's AIRC, indicating corporate research leadership in physical AI for household applications.
Quote: Listed as corresponding author with Jian Zhu (correspondence section).

Taiyi Su (AIRC, Midea Group)

Why notable: Co-author of both DSWAM and DeMaVLA, contributing to the matched comparison framework that makes this paper's evaluation credible.
Quote: First author of DeMaVLA [22], referenced as "the closest real-world reference for our study" (Section 2.1).

Kevin Black (Physical Intelligence / Stanford)

Why notable: Co-author of π₀, π₀.₅, and the RTC paper [6] that DSWAM builds on for real-time chunking. Represents the VLA side of the WAM-vs-VLA debate.
Quote: Co-authored RTC method that DSWAM uses: "DSWAM uses inference-time RTC [6] and asynchronous execution to decouple policy queries from the robot control loop" (Section 3.3.2).

5. Operating Insights

The WAM-vs-VLA Debate Now Has Empirical Evidence — WAMs Win on Contact-Rich Tasks

For CTOs evaluating robot policy architectures, this paper provides the first controlled, apples-to-apples comparison showing WAM execution outperforming VLA policies on real hardware. The matched DeMaVLA protocol (same robot, same data, same tasks, same criteria) isolates the policy design as the variable. The 3.8 percentage point improvement on folding (92.5% → 96.3%) with a 25% reduction in completion time is meaningful for production deployment. The biggest gains are on the hardest tasks — pants folding improved from 75% to 90% success. If your application involves deformable objects, contact-rich manipulation, or tasks where physical state evolution matters, WAM-style training supervision appears to provide a structural advantage over direct observation-to-action VLA policies.

Inference Latency Is Solved — But Only If You Engineer for It

The deployment stack matters as much as the model. DSWAM achieves 73.8ms end-to-end policy latency through three engineering choices: (1) dropping test-time video generation, (2) splitting the model into two TensorRT engines (visual-context + action-denoising), and (3) asynchronous RTC where policy inference runs in parallel with robot control. The asynchronous design alone improved pants folding from 70% to 100% success on easy instances (Table 5), showing that latency isn't just about speed — it directly affects task success because "continuous bimanual manipulation and contact-rich adjustment require frequent action updates" (Section 4.5). Teams deploying action chunking policies should prioritize asynchronous execution architectures.

Subtask Decomposition Is a High-ROI Intervention for Multi-Step Tasks

The System 2 study shows that decomposing coarse instructions into subtask-level instructions before training improves both success rate (75.7% → 100%) and reduces errors per rollout by 5.4× (3.53 → 0.65). Critically, subtask-supervised training reaches 100% success at 6,000 steps while raw instruction training only reaches 80% at 18,000 steps — a 3× sample efficiency improvement. For teams collecting robot data, this suggests that investing in automatic subtask annotation (using VLM annotators to segment trajectories) could dramatically reduce the data volume needed for reliable multi-step task execution.

6. Overlooked Insights

The System 2 Planner Is Robust to Variable-Frequency Visual Inputs Despite Being Trained at Fixed 1 FPS

The paper notes that "although System 2 is trained with a fixed 1 FPS sampling regime, we find it robust to the variable-frequency visual inputs produced by real robot execution" (Section 3.2, Coupling with System 1). This is buried but operationally significant: it means the planner doesn't need precise temporal synchronization with the executor, simplifying deployment. The planner queries every 2 seconds (Equation 8), and the returned subtask conditions the executor until the next update. This loose coupling between planning and execution frequencies is a practical design choice that reduces system complexity.

Action Tokens Are Prevented from Using Future Visual Tokens as Privileged Information During Training

A subtle but important training detail: "During training, future visual tokens provide world-modeling supervision, but the action tokens are prevented from using future visual tokens as privileged information. This keeps the action policy aligned with the inference-time setting, where only current observations are available" (Section 3.3.1). This prevents a common training-inference mismatch where the model "cheats" by looking at future visual predictions when generating actions, which would fail at deployment when no future video is generated. This architectural choice is what makes the no-video-generation-at-inference design actually work.