CoDA: Co-Evolution of… | arXiv Physical AI Research Summary

1. Key Themes

Closed-Loop Data Generation That Targets Policy Weaknesses, Not Just Random Variation

CoDA's core contribution is making simulation data generation adaptive — the system generates environments specifically designed to expose and then fix the policy's current failure modes. Rather than randomly varying scenes or using success rates as a blunt allocation signal, CoDA uses a vision-language critic to diagnose why the policy fails (which scene factor, which trajectory phase, what cause), then generates targeted environments and training programs to address those specific weaknesses. The result: out-of-distribution success jumps from 5.3% (supervised fine-tuning) to 27.6%, and from 18.1% (success-rate-guided generation) to 27.6% — a 52% relative improvement over the strongest closed-loop baseline using the same generation budget (Section 1, Table 1).

Dense Supervision via Text2potential Without Breaking Optimal Policies

A persistent problem in robot learning is that sparse success/failure signals make value learning slow for multi-step tasks, but hand-crafting dense rewards is expensive and can teach the wrong behavior. CoDA's Text2potential compiles failure diagnoses into staged potential functions over simulator states, providing dense feedback for action-chunk value learning. Critically, this preserves the policies that maximize the original task return under standard reward-shaping theory (Section 3.4, 3.5). The practical effect: Text2potential reaches 25% OOD success after 21k policy updates versus 31k for sparse rewards — roughly 32% fewer training steps (Table 4).

Memory That Transfers Across Tasks and Policy Backbones

CoDA's shared memory organizes experience into episodic traces, reusable difficulty modes, and compiled programs. These programs are expressed over symbolic object roles (target, obstacle, support) rather than specific instances, enabling transfer across task families. Cross-family transfer achieves 60.3% of within-family learning progress versus 35.8% for programs learned from scratch with the same LLM budget (Table 6). Even more striking: memory collected with π0.5 transfers to OpenVLA-OFT, raising its OOD success from 3.8% to 21.1% with no additional environment generation (Table 7). This suggests the accumulated "knowledge of what's hard" is a reusable asset, not tied to a specific model.

Dramatic Robustness Gains on Standardized Benchmarks

On LIBERO-Pro, 15 rounds of CoDA training raise π0.5's success from 25% to 84% under position perturbations and from 1% to 76% under instruction perturbations, while preserving 97.4% success on standard LIBERO (Table 2). For context, the base π0.5 model achieves only 0.25 and 0.01 overall success under these perturbations. CoDA also exceeds ASPIRE (a code-as-policy approach) by 7-9 percentage points overall.

2. Contrarian Perspectives

Success Rate Is the Wrong Signal for Data Generation

Most robotics companies using simulation for training data allocate generation effort based on task success rates — generate more environments where the policy is failing. CoDA argues this is insufficient because success rate tells you whether the policy fails but not why or how much it can improve. The paper shows that generation guided by per-task success rates achieves only 18.1% OOD success, while CoDA's diagnosis-guided generation achieves 27.6% — and the gap widens with more rounds (42.1% vs. much smaller gains for success-rate-guided methods) (Section 1, Figure 3). The argument: without understanding the cause of failure and measuring learning progress, generators waste budget on environments the policy has already mastered or cannot yet learn from.

A Single Shared Memory Representation Is Worse Than Specialized Programs

A natural assumption would be that a unified memory store — one representation serving both scene generation and policy training — would be simplest and most effective. CoDA's ablation shows the opposite: retaining both specialized generation programs (Ω) and training programs (Φ) yields 27.6% OOD success, while single-memory alternatives (raw trajectory retrieval, distilled insights, or a skill library) all cluster around 20-22% (Table 5). The 8.4-percentage-point gain from retaining both program types exceeds the sum of individual gains (3.6 + 2.9 = 6.5 points), indicating genuine synergy between targeted generation and targeted training.

LLM-Generated Dense Rewards Can Hurt; Potential-Based Shaping Is Safer

The paper implicitly challenges the growing trend of using LLMs to generate free-form reward functions (e.g., Eureka, Text2Reward). CoDA's ablation shows that free-form dense rewards (not structured as potentials) achieve only 23.5% OOD success versus 27.6% for Text2potential, and require more training steps (33k vs. 21k to reach 25% OOD) (Table 4). The reasoning: free-form rewards can favor behaviors other than task completion, while potential-based shaping provably preserves the optimal policy under standard assumptions (Section 3.5).

3. Companies Identified

Physical Intelligence (π0.5), VLA model developer, Used as the primary policy backbone for all main experiments. CoDA's results directly demonstrate that π0.5's robustness can be dramatically improved through adaptive simulation training. "We evaluate CoDA on four manipulation task families and LIBERO-Pro using π0.5 as the primary policy backbone" (Section 4). The base π0.5 achieves only 25% position perturbation success and 1% instruction perturbation success on LIBERO-Pro, which CoDA raises to 84% and 76%.

OpenAI (GPT-5.5), LLM provider, Used as the default model for scene generation, failure diagnosis, and potential compilation. "The data engine, rollout-diagnosis model, and potential compiler all use GPT-5.5" (Appendix B). The paper also tests Claude Opus 5, InternVL3-78B, and Qwen3-VL-235B, finding the framework remains effective across all four, though GPT-5.5 performs best (Table 3).

Anthropic (Claude Opus 5), LLM provider, Tested as an alternative diagnosis critic, achieving 26.1% OOD success (vs. 27.6% for GPT-5.5) with 81.5% human agreement on diagnoses (Table 3).

NVIDIA (cuRobo), Motion planning SDK, Used to generate planner-certified demonstrations for imitation supervision. "Planner-certified demonstrations are obtained using cuRobo" (Appendix B). This is relevant for companies considering automated demonstration generation pipelines.

Stanford/UC Berkeley (OpenVLA-OFT), Open-source VLA model, Evaluated as a secondary policy backbone to test memory transfer. CoDA's memory collected with π0.5 raises OpenVLA-OFT's OOD success from 3.8% to 21.1% without additional environment generation (Table 7), demonstrating cross-backbone value.

4. People Identified

Tianjiao Yu, University of Illinois Urbana-Champaign (Plan Lab), Lead author with prior work on part-level 3D generation (DreamPartGen, Part2GS). This paper represents a shift from asset generation to the harder problem of adaptive data generation for policy training.

Ismini Lourentzou, University of Illinois Urbana-Champaign, Senior author and lab lead. Her group spans vision-language models and embodied AI, positioning this work at the intersection of foundation model reasoning and robot learning.

Fan Wang, Amazon, Co-author from Amazon, suggesting potential industry relevance or corporate research interest in adaptive simulation for robot training.

Sergey Levine, UC Berkeley (referenced via [15], [24]), His work on action chunking for RL and advantage-weighted regression forms the theoretical backbone of CoDA's policy update mechanism. The chunk-level value learning approach (Li, Zhou, Levine 2025) is directly adopted.

Kevin Black, Chelsea Finn et al., Physical Intelligence (referenced via [8]), Developers of π0.5, the primary policy backbone. Their open-world VLA model serves as the base that CoDA adapts and improves.

5. Operating Insights

Build a Feedback Loop Between Data Generation and Policy Training, Not Just a Pipeline

The single most actionable takeaway: if you're generating simulation data for robot training, don't treat it as a one-way pipeline. CoDA's 52% relative improvement over success-rate-guided generation (the current industry default) comes from closing the loop — diagnosing why the policy fails, generating environments that recreate those specific difficulties, and compiling training programs that address them. The cost is non-trivial (7.4M LLM tokens and 66 GPU-hours per 1,000 accepted environments, per Table 9), but the efficiency gains from not wasting generation budget on already-mastered or unlearnable environments may offset this. For a CTO: your data generation infrastructure should include a diagnostic layer that feeds back into what gets generated next.

Invest in Reusable Difficulty Knowledge, Not Just Environments

CoDA's cross-task transfer results (Table 6) show that generation programs learned in one task family achieve 60.3% of within-family learning progress when transferred to a new family, versus 35.8% for from-scratch programs at the same LLM cost. Cross-policy transfer (Table 7) shows memory from π0.5 boosts OpenVLA-OFT by 18.9 percentage points with zero new environment generation. The strategic implication: the accumulated knowledge of "what's hard for robots" — encoded as reusable programs indexed by difficulty mode — is a compounding asset. Companies that build this kind of memory across tasks and policy versions will have a data efficiency advantage that grows over time, creating a moat.

Potential-Based Shaping Is a Safer Bet Than LLM-Generated Rewards

If you're using LLMs to generate training signals, CoDA's ablation (Table 4) provides evidence that structured potential-based shaping (27.6% OOD, 21k steps to target) outperforms free-form dense rewards (23.5% OOD, 33k steps) and task-description-derived potentials (24.6% OOD, 29k steps). The theoretical guarantee of policy invariance under potential-based shaping (Section 3.5) means you're less likely to train your robot to optimize for the wrong behavior. For engineering teams: prefer structured shaping functions compiled from failure diagnoses over open-ended reward synthesis.

6. Overlooked Insights

18.2% of LLM Diagnoses Are Wrong — and Control Experiments Catch Them

The paper reveals that nearly one in five failure diagnoses produced by the vision-language critic are refuted by control experiments — targeted variants that modify the identified factor are no harder than control variants modifying a different factor (Table 8). Without these control tests, human agreement on diagnoses is 73.6%; with them, it rises to 82.4%. This is a critical operational detail: LLM-generated diagnoses are noisy, and any system relying on them for training signal generation needs a validation mechanism. Companies building similar pipelines should budget for control batches and expect to discard a meaningful fraction of automated diagnoses.

Adaptive Scheduling Reduces Cost While Improving Performance

The comparison between fixed and adaptive round scheduling (Table 9) shows that triggering new generation rounds based on remaining difficulty modes and learning progress — rather than at fixed intervals — reduces LLM token usage by ~11% and GPU time by ~11% while increasing OOD success from 26.1% to 27.6%. This is a free win: the scheduling logic itself is simple, but it means you should not generate new environments on a fixed cadence. Wait until the policy has extracted sufficient learning from current environments before spending generation budget.