When Do Discrete… | arXiv Physical AI Research Summary

1. Key Themes

Discrete Actions Match or Beat Continuous Actions Across All Regimes

The paper systematically compares four action representations—continuous regression (CR), continuous flow (CF), discrete regression (DR), and discrete flow (DF)—across single-task imitation learning, multi-task VLA training, simulation benchmarks (RoboMimic, RoboCasa, LIBERO), and real-world robot tasks. The headline result: discrete actions consistently match or outperform continuous ones. As stated in Section 3: "discrete flow is competitive with, and often slightly surpasses, continuous flow. More surprisingly, discrete regression consistently outperforms continuous regression." On RoboCasa, DF achieves 53.9% success vs. CF's 52.7% and CR's 38.8%. This holds even on precision-demanding tasks like Tool Hang and Transport in RoboMimic, and on real-world tasks (throwing bottles into bins, opening pen caps, turning mugs upright).

The Real Bottleneck Is Factorization Error, Not Precision

The paper identifies "factorization error" as the core challenge for discrete policies—not quantization precision as commonly believed. When each action token is predicted independently, plausible-but-incompatible alternatives across time steps and action dimensions can combine into invalid actions. As Section 4 explains: "When an observation admits several plausible behaviors, different token distributions can assign probability to alternatives behaviors independently. These independent choices can combine incompatible alternatives across time steps and action dimensions." The paper shows that ℓ2 reconstruction errors across all parametrizations are "roughly similar, and show no consistent correlation with task success" (Appendix F.2), directly refuting the precision-loss hypothesis.

Iterative Refinement and Guidance Are the Key Interventions

Two mechanisms fix factorization error: (1) iterative computation via discrete flow (DF), which reduces inconsistent-mode predictions per chunk by a factor of 5.28 relative to DR (Section 4, Finding C), and (2) classifier-free guidance (CFG), which "sharpens" the distribution and raises DR success from 27.1% to 49.2% on RoboCasa (Section 4, Finding B). With CFG 2, DR approaches DF's performance, suggesting that distribution sharpening alone can largely compensate for factorization error without iterative computation.

Explicit Geometric Structure Provides Minimal Additional Benefit

Attempts to inject geometric information—metric-induced corruption paths for DF, distance-based label smoothing for DR, and alternative tokenizers (nFSQ, RVQ, FAST, quantile bins)—do not exceed the best result of plain uniform-bin DF with a standard mixture path (53.9% on RoboCasa). As Section 5 states: "Explicit geometry therefore provides a modest gain for DR but does not improve the best observed DF result." The paper finds that adjacent bins naturally acquire similar output embeddings, suggesting the model learns local geometry implicitly without explicit encoding.

2. Contrarian Perspectives

Continuous Action Prediction Is Not Necessary for Precise Robot Control

The prevailing wisdom in the VLA community—embodied by π0, π0.5, GR00T N1, and most diffusion/flow policies—is that robot actions must be predicted as continuous values for high precision. This paper directly challenges that: "Contrary to prior belief, discrete action parametrizations, even discrete regression (DR) with the simplest bin discretization, can exhibit greater control precision than their continuous counterparts, despite the possibly lossy quantization of actions!" (Section 3, Finding 1). The paper shows discrete policies better capture temporal variation (jerk ratios closer to 1.0) and state responsiveness than continuous ones, because "continuous objectives underweight/over-smooth small action differences compared to categorical prediction" (Section 3.1). Most robotics companies building VLA stacks have invested heavily in continuous flow/diffusion heads—this paper suggests that investment may be unnecessary.

Discrete Policies' Advantage Comes from Reactivity, Not VLM Compatibility

A common explanation for why discrete actions might help in VLA settings is that they're more compatible with token-based VLM backbones. This paper refutes that: "The fact that discrete regression outperforms its continuous counterpart, even on single-task from scratch training, debunks... that discrete policies are only beneficial in VLA settings, where it has been hypothesized, that discrete predictions are more compatible with token-based VLM backbones" (Section 3). The advantage is architectural—discrete prediction decouples time steps probabilistically, enabling greater temporal variation and state responsiveness—even without a pretrained language model.

Fancy Tokenizers Are Unnecessary; Uniform Binning Is Sufficient

The robotics community has invested significant effort in sophisticated action tokenizers (FAST, VQ-VAE, B-spline encoding, residual vector quantization). This paper finds that none of these exceed plain uniform-bin discretization with 512 bins when paired with discrete flow: "none of these exceeds our best DF result with uniform bins and the standard mixture path" (Section 5). This suggests that engineering effort spent on tokenizer design may be better directed at the prediction head and inference-time interventions.

3. Companies Identified

Amazon (FAR - Frontier AI & Robotics), Employer of several authors and co-affiliated institution, Why relevant: This is an internal Amazon research effort, suggesting Amazon is actively investigating discrete action representations for their robotics stack. The paper uses Amazon's compute resources and likely reflects strategic interest in alternatives to continuous-action VLA architectures. Quote: "2Amazon FAR (Frontier AI & Robotics)" (Title page).

Physical Intelligence (π-series), VLA company whose π0 and π0.5 models use continuous flow matching, Why relevant: Their architecture is directly challenged by this paper's findings. The paper uses the same PaliGemma VLM backbone as the π-series models and shows discrete flow matches or beats continuous flow. Quote: "We post-train the PaliGemma Beyer et al. [2024] VLM, used by the π-series models Black et al. [2025], Physical Intelligence et al. [2025b]" (Section 3). Also noted: "π∗0.6 notes that large weights push actions to the corners of the support and cause aggressive motions" (Appendix A, CFG discussion).

Google DeepMind (RT-1, RT-2), Early adopter of discrete action tokens, Why relevant: RT-1 used 256 uniform bins per action coordinate, and RT-2 reused these as VLM tokens. The paper validates this early design choice and suggests the field's subsequent move to continuous heads may have been premature. Quote: "RT-1 discretizes each action coordinate into 256 uniform bins [Brohan et al., 2022], RT-2 and OpenVLA reuse such bins as tokens of a pretrained vision-language model" (Appendix A).

NVIDIA (GR00T N1), Open foundation model for humanoid robots using continuous actions, Why relevant: GR00T N1 is cited as a representative continuous-action VLA. The paper's findings suggest NVIDIA's choice of continuous action parametrization may not be optimal. Quote: "NVIDIA et al., 2025" cited among VLAs that "predict actions using continuous-space generative models" (Section 1).

Stanford/UC Berkeley (OpenVLA, Octo), Open-source VLA models, Why relevant: OpenVLA uses discrete tokens from RT-1's binning, and Octo uses a diffusion head. The paper's related work section notes that prior comparisons between these approaches were confounded by architectural differences: "The discrete head usually decodes tokens autoregressively... and the continuous head is a new MLP" (Appendix A). This paper's controlled comparison isolates the action representation variable.

4. People Identified

Guanya Shi, Carnegie Mellon University & Amazon FAR, Why notable: Co-senior author with equal advising. Shi is a rising figure in robot learning and control theory, with prior work on flow-based policies. His lab bridges academic robotics and industrial deployment at Amazon. Quote: Co-authored the paper with equal advising responsibility.

Max Simchowitz, Carnegie Mellon University & Amazon FAR, Why notable: Co-senior author. Simchowitz is known for theoretical work in online learning and control, bringing rigorous analytical framing to empirical robotics questions. His involvement signals that this paper's claims are theoretically grounded, not just empirical. Quote: Co-authored with equal advising responsibility.

Koushil Sreenath, Carnegie Mellon University, Why notable: Sreenath's lab focuses on control theory and robotics, particularly bipedal locomotion and manipulation. His involvement connects this work to the control theory community, lending credibility to the precision and reactivity claims. Quote: Listed as author, affiliation "Carnegie Mellon University."

Kevin Black, Physical Intelligence, Why notable: Black is a key author of π0 and π0.5 at Physical Intelligence, whose continuous flow architecture is directly challenged by this paper. He is cited as an author of the π-series models that this paper benchmarks against. Quote: Cited as author of "π0: A vision-language-action flow model for general robot control" (References).

5. Operating Insights

Consider Discrete Flow as Your Default Action Head, Not Continuous Flow

For teams building VLA models, the paper provides strong evidence that discrete flow (DF) with uniform 512-bin quantization, a standard mixture path, and ~10 refinement steps (NFE) is a safe default that matches or beats continuous flow while enabling unified token-based architectures. The paper shows DF achieves 53.9% on RoboCasa vs. CF's 52.7%, and this holds across real-world tasks. The practical advantage: discrete actions can share the same token-based infrastructure as language and vision, simplifying the model architecture and potentially enabling co-training across modalities. As the paper concludes: "These results make a strong case for treating discrete action prediction as a central component of future robot foundation models" (Section 6).

If You're Using Discrete Regression, Add Classifier-Free Guidance Immediately

For teams already using discrete regression (single-pass token prediction, as in RT-1/RT-2-style architectures), the paper shows that adding classifier-free guidance with λ=2 nearly doubles performance: from 27.1% to 49.2% on RoboCasa (Section 4, Finding B). This is a low-cost intervention—it adds one action-head forward pass per inference call, since "the backbone encodes o once per inference call, so guidance adds one action-head pass per head evaluation" (Section 2, CFG subsection). If your team is using plain discrete regression without CFG, you're leaving significant performance on the table.

Don't Over-Invest in Custom Tokenizers

The paper tested FAST, nFSQ, RVQ, and quantile binning against plain uniform bins, and none exceeded uniform-bin DF's best result. If your team is spending engineering effort on custom action tokenizers to improve VLA performance, this paper suggests that effort may be better spent on the prediction head (iterative refinement, guidance) rather than the tokenizer. The one exception: if you're using discrete regression without guidance, quantile bins or nFSQ can help (49.8% and 41.6% vs. 27.1% for flat bins on RoboCasa, per Appendix G.1), but guided flat-bin DR (49.2%) already matches quantile bins.

6. Overlooked Insights

Continuous Regression Suffers from Temporal Over-Smoothing, Not Just Mode Averaging

The paper introduces the "jerk ratio" metric (R_jerk), measuring how well a policy captures the third derivative of motion (jerk) within an action chunk. Continuous regression consistently produces jerk ratios substantially below 1.0, meaning it over-smooths the temporal profile of actions. Discrete regression's jerk ratio is close to or above 1.0. As Figure 2(a) shows, this difference persists even when comparing flow variants, though it narrows. This has a practical implication: continuous regression policies will produce visibly "smoother" but less responsive robot motions, potentially causing failures in tasks requiring quick direction changes or precise small movements. The paper corroborates this with synthetic function-fitting experiments in Appendix H.1, showing categorical prediction preserves fine temporal structure that regression smooths over.

Discrete Flow Maintains Action Diversity While Reducing Inconsistency

A subtle but important finding: DF maintains high action diversity (measured by W90 width and t-SNE spread) even as it reduces factorization error. This means DF isn't collapsing to a single mode—it's preserving the ability to represent multiple valid behaviors while ensuring the tokens within a single chunk are mutually consistent. As Section 4 notes: "DF exhibits greater action diversity than DR... action diversity remains relatively constant" across refinement steps. This challenges the assumption that you need continuous distributions to capture multimodality in robot actions—discrete flow can do both, which matters for tasks where multiple valid trajectories exist (e.g., approaching an object from different angles).