Meituan-Robotics-0: A… | arXiv Physical AI Research Summary

Bottom line: Meituan — a company whose core business is food delivery and local services — has published a full-stack VLA foundation model for desktop manipulation that goes head-to-head with Physical Intelligence's π0.5 and wins on matched real-robot evaluations, while using roughly 13.6k hours of embodied training data versus competitors claiming 100k+ hours. The paper is less a model announcement than an operational playbook for data curation, failure recovery, and deployment-grade system architecture.

1. Key Themes

A Chinese delivery giant is building a credible VLA stack, and it's open about the recipe

MR0 combines "147 million vision-language samples with 15,060 hours of curated robot trajectories spanning 12 embodiments" (Abstract, Section 2). The robot corpus is 50% licensed real-robot data (7,530 hours), 21.5% curated open-source real data ("RoboDesk," 3,235 hours), and 28.5% simulation (Figure 3, Table 2). The model itself is built on a Qwen3.5-4B backbone with an MMDiT continuous action head (Section 3.1), and the team is releasing homepage, GitHub, model, and data links (per the paper header). This signals Meituan intends to compete in embodied AI as a platform player, not just deploy internally.

Three-stage training: discrete tokens are scaffolding, continuous control is the product

The training recipe deliberately separates concerns: (1) discrete FAST action-token pre-training aligns the VLM backbone with robot behavior, (2) flow-matching mid-training on a continuous MMDiT head transfers those representations to fine-grained cross-embodiment control, (3) real-world post-training (SFT → HG-DAgger / RECAP / CFG-DAgger) adapts to deployment (Section 3.2). Critically, the discrete interface is thrown away: "Because FAST tokenization introduces action-reconstruction error, downstream stages discard the token interface in favor of continuous prediction" (Section 3.2.1).

Rollback + CFG-DAgger: learning from failure without RL machinery

The paper's most novel contribution is Rollback, a data collection method where an operator pauses a failing rollout, rewinds the robot to a historical anchor using action history, and provides a human correction — yielding paired positive/negative segments from the same state (Figure 6). These pairs train CFG-DAgger directly: "CFG-DAgger avoids value learning and advantage labeling, while outperforming RECAP in our real-robot evaluation" (Section 3.2.3). On Ethernet insertion, CFG-DAgger reaches 70% success and 0.90 progress score versus 0.60 SR / 0.67 PS for RECAP (Section 5.2.2, Figure 11).

Competitive results at a fraction of the data scale

MR0 achieves 93.6% overall success on RoboTwin 2.0, the highest among 16 compared methods including π0.5 (79.8%) and GalaxeaVLA G0.5 (93.3%) (Table 4). On RoboDojo, it ranks fifth in the VLA track with ~13.6k hours of embodied data, while Xiaomi-Robotics-1 reports ">100k hours" and Rex-M1 inherits that same lower bound (Table 5). Under matched HG-DAgger post-training on three real tasks, MR0 beats π0.5 on average success rate and progress score, with the largest gap on Ethernet insertion (Figure 10).

The system, not just the policy: event-driven agent for long-horizon state

Because the VLA policy is purely reactive (no temporal history), MR0 layers an agent on top: a 2 Hz Monitor converts visual windows into structured captions, a Memory Manager consolidates them into persistent events with keyframes, and a Planner is invoked "only when a new event changes task progress, reveals a failure, or alters whether the current objective is feasible" (Section 4.2, Figure 8). Demonstrations show cross-task event retrieval (locating a key a human moved to a different drawer, Figure 13) and task resumption after a precondition temporarily disappears (Figure 14).

2. Contrarian Perspectives

Discrete action tokens are a pre-training tool, not a control strategy

A significant school of VLA development treats action tokenization (FAST-style) as the path to scaling. MR0's data says otherwise: tokenization is used only in stage 1 to co-train robot actions with the VLM vocabulary, then abandoned because of reconstruction error (Section 3.2.1). The RoboTwin comparison reinforces this: "both methods [MR0 and ABot-M0] predict clean actions and optimize a velocity-space loss, yet MR0 achieves 8.0 points higher overall success... action-head parameterization alone does not determine downstream performance" (Section 5.1). The signal for builders: don't pick your VLA architecture fight over tokenization — data alignment and post-training dominate.

You may not need value functions or RL to learn from failure

The field is converging on RL-style post-training (RECAP, VLA-RFT, VLA-R1 are all cited in Section 3.2.3). MR0's counter-argument: paired positive/negative segments from Rollback give you direct supervision, and classifier-free guidance at inference ("extrapolating from the positive prediction away from the negative prediction," γ = 1.25, Section C.3) beats a learned value model — 0.70 vs 0.60 SR on Ethernet insertion (Figure 11). For a startup, this matters enormously: value learning requires a separate value network, outcome labeling, and advantage estimation infrastructure; Rollback requires only a rewind-capable data collection UI.

Raw data scale is not the moat — curation is

Xiaomi reports >100k hours of pre-training data; MR0 uses ~13.6k hours and ranks ahead of Xiaomi-Robotics-1 on RoboDojo (14.63% vs 13.93% SR, Table 5). The paper explicitly frames this: "competitive overall performance at a relatively modest data scale, suggesting effective use of heterogeneous pre-training data" (Section 5.1). The pipeline behind this — static-boundary trimming, FK-based kinematic consistency checks against URDFs, video-defect filtering, and cross-embodiment action canonicalization (Section 2.2.1, Figure 4) — is unglamorous but is where the performance actually comes from.

3. Companies Identified

Meituan — Chinese local-services/delivery giant; the paper's author. Relevant as a new entrant in the VLA foundation model race with real deployment ambitions (desktop manipulation maps to kitchen/food-prep automation). Releasing model, code, and data per the paper header.
Physical Intelligence — Maker of π0, π0.5, and the RECAP method (π*0.6). MR0 uses π0.5 as its primary real-robot baseline and beats it under matched post-training (Figure 10); it also adopts and then improves upon RECAP (Figure 11). Competitive position directly challenged.
Alibaba/Qwen Team — Qwen3.5-4B is MR0's backbone (Section 3.1); Qwen3.5-35B-A3B runs the Monitor/Memory/Planner agent (Section 5.2.3); Qwen-VLA-Instruct appears as a RoboTwin competitor (Table 4). Qwen is becoming the default VLM substrate for Chinese robotics.
Xiaomi Robotics — RoboDojo competitor with ">100k hours" of claimed embodied data (Table 5); MR0 outperforms it with ~7x less data.
AgiBot — AgiBotWorld-Beta is the single largest data source in MR0's corpus at 2,174 hours, 14.4% (Table 2). AgiBot is a key data supplier to the ecosystem.
Galaxea — Supplies 333 hours of open-world data (Table 2) and fields GalaxeaVLA (G0.5), which slightly trails MR0 on RoboTwin (93.3% vs 93.6%, Table 4) and on RoboDojo.
AgileX — Hardware supplier: MR0's real-robot setup is a "bimanual AgileX PiPER" teleoperation rig (Appendix A).
Dexmal, LiberAI, Futian Lab/VisIncept, SIPAILab, Awomo — RoboDojo leaderboard competitors (Table 5); Dexmal's DM0.5 and Simate-beta currently outperform MR0 on that benchmark.
NVIDIA (GR00T), Google (SigLIP2, Gemma) — Component suppliers: SigLIP2-So400m and Gemma 3 270M are used in the RECAP value model (Section C.2); GR00T cited as a VLA design reference.
Meta (SAM) — Segment Anything is used in the 2D grounding annotation pipeline via Set-of-Mark prompting (Section 2.1).

4. People Identified

Jie Hu — Project leader (marked † in Contributions). Leads Meituan's robotics foundation model effort; the paper's 37 authors indicate a serious, well-resourced team.
Guang-Lu Wan, Xunliang Cai, Yuchen Xie — Sponsors (marked ‡), signaling executive-level backing inside Meituan for the robotics program.
Kevin Black, Sergey Levine, Chelsea Finn (Physical Intelligence / UC Berkeley) — Their π0/π0.5, FAST tokenization, and real-time chunk-execution work (references [33], [45], [36], [40]) form the technical scaffolding MR0 builds on and then competes against. HG-DAgger itself is Kelly et al. [19].
Kaiming He & Tianhong Li — The JiT "clean-sample parameterization" (reference [37]) used for MR0's flow-matching objective; a notable transfer of computer-vision denoising insights into robot control.
Yao Mu, Tianxing Chen — Authors of RoboTwin 2.0 and RoboDojo (references [24], [25]), the two benchmarks anchoring MR0's evaluation; central figures in the bimanual manipulation benchmark ecosystem.

5. Operating Insights

Budget for data curation as seriously as for data collection

The pipeline in Section 2.2.1 and Figure 4 is the operational gold here: static-prefix/suffix trimming (idle teleoperation segments "bias the action distribution"), FK-reconstruction checks against URDFs to catch joint–EEF logging mismatches, and video-defect detection (blur, black frames, decode failures). If you're buying or licensing robot data, this is your due-diligence checklist — and note that Meituan's corpus is 50% licensed real data, implying a real market for high-quality robot trajectory licensing.

The asynchronous chunk-merging controller is a deployable blueprint

Section 4.1, Figure 7, Appendix B, and Table 7 give the full spec for running a 3 Hz policy against a 30 Hz control loop: drop up to Klat = 4 stale commands, linearly blend the overlap between old and new chunks, and pad short buffers to a minimum of 8 commands. This solves the "VLA inference is too slow for smooth control" problem that blocks many deployments, and the complete algorithm (Algorithm 1) is published. Any CTO shipping chunk-based policies should implement this pattern.

HIL correction data has task-dependent returns — plan collection accordingly

Figure 12 shows letter-block placement and garment folding improve rapidly then plateau with more human-correction episodes, while Ethernet insertion "continues to improve." Precision-critical, multi-milestone tasks consume correction data without saturating. Also notable: "Neither SFT policy succeeds on garment folding" (Section 5.2.2) — success-only demonstrations fundamentally cannot teach recovery, so plan for intervention data collection from day one.

6. Overlooked Insights

The CALVIN ablation tells you exactly which embodied annotations to buy

Table 1 is buried in the data section but is arguably the highest-ROI finding for anyone building VLM co-training data. Across eight candidate supervision types, 2D target-affordance grounding delivered the largest gain (Avg. Len. 3.832 → 4.102, with Task-1 success jumping from 91.0% to 93.3%), and the team chose 2D over 3D grounding explicitly because it "avoids costly geometric annotations and scales more readily." Meituan then scaled only three annotation types — 2D grounding, 2D affordance grounding, and scene captioning — for its 147M-sample corpus. That's a concrete answer to "which VQA data is worth annotating at scale."

Open-vocabulary instruction following is quietly broken

Beneath the fifth-place RoboDojo ranking: MR0 scores just 3.59 (3.38% SR) on the Open-vocabulary category, and the paper admits the policy exhibits "a remaining bias toward familiar actions when interpreting unfamiliar instructions" — e.g., grasping a box instead of aligning it on Align_blocks (Section 5.1). Every compared VLA model is weak here (best is 9.12). For investors, this is the gap between demo-ready manipulation and genuinely instructionable robots — and a signal that "generalist" VLA claims should be discounted heavily on open-vocabulary tasks. Also worth noting: the agent demonstrations (Figures 13–14) are qualitative, not quantitative — the memory/recovery story is promising but not yet benchmark-validated.