A Phenomenology of… | arXiv Physical AI Research Summary

1. Key Themes

VLA Models Encode Physical Variables as Multi-Dimensional, Curved Geometry — Not Single Directions

The paper's central finding is that task-relevant variables in VLA policies are not represented as simple linear directions in activation space, but as curved, multi-dimensional structures shaped by physical constraints. The authors formalize this distinction between "realization" (can you decode a variable?) and "realized geometry" (what shape does it trace?). As they state: "Linear readability establishes only that a concept is present, while its realized geometry determines how its values are structured and whether they can be manipulated" (Section 1). This matters because most interpretability work in robotics has stopped at proving decodability, assuming the rest doesn't matter. It does.

Physical Constraints Directly Shape Internal Representations

The paper demonstrates that a robot's physical limitations are reflected in how its policy internally represents the world. Wrist orientation, which is cyclic and "should" be a circle, is instead encoded as an open arc because the joint limit is ±172.8° — the endpoints, only 14° apart physically, lie far apart in activation space (Figure 6a). The authors note: "Physical joint limits, for example, leave wrist orientation an open arc rather than a circle" (Abstract). This means the design of proprioceptive inputs (e.g., whether joint angles wrap) directly determines the geometry the model learns, with downstream consequences for controllability.

Distance Is Split Into Two Orthogonal Subspaces: A Coarse "Meter Ruler" and a Fine "Centimeter Ruler"

One of the most striking findings: a single scalar (distance to target) is encoded in two nearly orthogonal subspaces — one for far-range approach (15–70 cm, R² = 0.81) and one for near-range grasping (<15 cm, R² = 0.70). The two probe directions have a cosine of 0.04, versus ~0.23 for a split-half ceiling (Figure 3c). The authors explain: "the numerical precision of the embedding splits distance into orthogonal coarse (meter-scale) and fine (centimeter-scale) rulers" (Section 1). This is not an artifact of the probing method — on synthetic activations encoding distance along a single direction, the same probes come out nearly parallel (cosine 0.95). The model independently discovered this multi-scale representation.

These Geometries Are Universal Across Models and Transfer from Sim to Real

The authors reproduce their findings in π0.5 (Physical Intelligence) and MolmoAct2 on the real-world DROID dataset, finding that "all four variables are recovered in every model, with cross-model Procrustes similarities well above a shuffled-variable null" (Section 4). The two-scale distance code "reappears: in all three models, far points spread along the meter ruler while near points split off onto the centimeter ruler" (Section 4). This suggests these geometries are a fundamental property of how VLAs organize manipulation-relevant information, not quirks of a specific architecture or training pipeline.

Steering Along Realized Geometry Is Actionable — But Belief Edits and Action Edits Behave Differently

The paper demonstrates practical interventions: steering along the gripper's one-dimensional axis flips the commanded gripper state (Figure 7), while steering along the wrist's arc produces a "compensation effect" where the policy rotates opposite to the written angle by 1.0–1.3× (Figure 6d). The authors formalize a critical distinction (Box 1): edits to "belief" variables (like wrist angle) cause the policy to compensate, while edits to "action" variables (like gripper command) directly change behavior. This distinction is invisible to linear probing alone.

2. Contrarian Perspectives

Linear Probes and Sparse Autoencoders Are Insufficient for Understanding VLA Policies

Most mechanistic interpretability work in robotics relies on linear probes or sparse autoencoders (SAEs), both of which assume concepts live along single directions. The paper argues this is fundamentally limited: "A probe can ensure that a variable is decodable, yet says nothing about the structure through which the model 'realizes' it, and an SAE inherits the linear representation hypothesis (LRH), which casts each concept as a single direction in activation space and therefore fixes that structure in advance" (Section 1). For anyone building interpretability tools for robotics policies, this means the dominant methodology is missing the geometric structure that determines whether interventions will actually work.

Task Phase Is Not an Internal Clock — It's Inferred from Motion at Every Step

A natural assumption is that a VLA policy maintains an internal representation of where it is in a task sequence (reach → grasp → transport → place). The paper shows this is wrong: when the arm is frozen, the decoded phase shifts — "freezing during reach shifts the decoded phase toward grasp" (Section 3.2). The model doesn't keep a time index because "the model does not receive previous actions, it cannot keep an explicit time index and must re-derive phase from motion at each chunk" (Section 3.2). This has direct implications for deployment: any pause or stall in a real robot could be misinterpreted by the policy as a phase transition, potentially triggering premature gripper actuation. The data shows freezing "raises the fraction of steps commanding a closed gripper by 43 percentage points during reach" (Figure 5d).

Decodability Does Not Imply Steerability

The paper explicitly demonstrates that being able to read a variable from activations does not mean you can control it with a simple intervention. The authors prove this mathematically (Appendix A) and empirically: "a variable can be linearly readable yet require a geometry-matched edit to steer, and even then the edit may land on a belief the policy compensates against rather than an action it executes" (Section 5). This challenges the common assumption in the steering literature that finding a direction is sufficient for control.

3. Companies Identified

Physical Intelligence (π0.5)

Description: VLA model developer, creators of π0.5 with "open-world generalization"
Why relevant: One of three models tested for geometry transfer. The two-scale distance code and gripper steering structure were reproduced in π0.5 on real DROID data, with the distance structure actually "sharper in π0.5 and MolmoAct2 than in MolmoBot" (Section 4). The gripper steering vector's first principal component carries 59% of variance in π0.5 vs. 31% in MolmoAct2 (Figure 33).
Quote: "We reproduce these geometries in π0.5 (Physical Intelligence et al., 2025b) and MolmoAct2 (Fang et al., 2026) on the real-world DROID dataset" (Section 1)

Figure AI

Description: Humanoid robotics company, developer of Helix VLA model
Why relevant: Referenced as evidence of real-world VLA deployment. Figure's Helix 02 is cited alongside Gemini Robotics as deployed systems.
Quote: "Figure AI, 2026; Gemini Robotics Team, 2026; Figure AI, 2025b,a" (Section 1)

Google DeepMind (Gemini Robotics)

Description: Robotics division of Google DeepMind, developer of Gemini Robotics 1.5 and 2
Why relevant: Referenced as a leading deployed VLA system. The paper situates its work in the context of increasingly capable and deployed systems.
Quote: "Gemini Robotics Team et al., 2025; Figure AI, 2026; Gemini Robotics Team, 2026" (Section 1)

Goodfire

Description: AI interpretability company; employer of most authors
Why relevant: This is a Goodfire research paper. Goodfire is building interpretability tooling for AI systems, and this paper extends their neural geometry work into robotics/VLAs. The GitHub repo is hosted under goodfire-ai.
Quote: "We thank our colleagues at Goodfire for valuable feedback at various stages of the project" (Acknowledgments)

NVIDIA (GR00T N1)

Description: Open foundation model for generalist humanoid robots
Why relevant: Referenced in the VLA landscape as a prominent model, though not directly tested in this paper.
Quote: "Bjorck et al., 2025" (Section 1, references list)

MolmoBot / Allen Institute for AI (AI2)

Description: VLA model from Deshpande et al. (2026), built on Molmo VLM backbone, trained in MolmoSpaces simulation
Why relevant: The primary model studied in the paper. Chosen because "it is a relatively strong policy on numerous benchmarks... its weights are open, so we can record and edit activations; and it runs in MolmoSpaces, which provides ground-truth task variables and lets us intervene on the world mid-rollout" (Section 3).
Quote: "Our subject is MolmoBot (Deshpande et al., 2026), which pairs a VLM that reads the language instruction and camera images of the scene with an action expert that reads the robot's proprioceptive state and generates action chunks via flow matching" (Section 3)

4. People Identified

Mozes Jacobs, Aiden Swann, Mathilde Papillon

Lab/Institution: Goodfire / Harvard / Stanford / UCSB (equal contribution)
Why notable: Lead authors of this work, bridging Goodfire's interpretability research with academic institutions. This team is building the bridge between mechanistic interpretability and robotics.
Quote: "⋆Equal contribution" (author list)

Thomas Fel, Matthew Kowal

Lab/Institution: Goodfire (equal senior contribution)
Why notable: Senior authors who have been driving the "neural geometry" research agenda. Fel has published extensively on concept manifolds in vision models (DINO, archetypal SAEs, block-sparse featurizers). Kowal is a recurring co-author across this line of work.
Quote: "†Equal senior contribution" (author list)

Vasudev Shyam

Lab/Institution: Goodfire
Why notable: Listed author at Goodfire, part of the core team extending neural geometry into physical AI.

Tom McGrath

Lab/Institution: Goodfire
Why notable: Co-author on the broader "Neural Geometry" research program (Geiger et al., 2026), which this paper extends into VLAs.

Atticus Geiger

Lab/Institution: Goodfire
Why notable: Named in the "Neural Geometry" research line (Geiger et al., 2026), suggesting involvement in the theoretical framework underpinning this work.

Ekdeep Singh Lubana

Lab/Institution: Goodfire
Why notable: Prolific researcher across interpretability, SAEs, and representation geometry. Author on multiple referenced papers including priors in language model interpretability and SAE concept manifolds.

5. Operating Insights

Your Robot's Proprioceptive Input Format Determines Its Internal Geometry — Choose Carefully

The paper shows that the action expert encodes wrist orientation as an open arc because it receives the raw, non-wrapping joint value, while the VLM (which only sees images) encodes it as a near-circle (Figure 22). After a full 360° turn, "the images are identical but its activation does not return to the start, while the VLM's does" (Section 3.3). For anyone designing a VLA's input representation: if you feed raw joint angles without wrapping, the model cannot learn the cyclic structure of orientation, which means steering interventions along that concept require state-dependent edits rather than a fixed vector. This is a concrete design decision with measurable downstream consequences for controllability.

Pauses and Stalls Can Trigger Unintended Gripper Actuation in Deployed VLAs

The freezing experiment reveals that VLA policies infer task phase from motion, not from an internal clock. When the arm is frozen during the reach phase, the policy shifts toward "grasp" and "raises the fraction of steps commanding a closed gripper by 43 percentage points" (Figure 5d). In real-world deployment, any situation that causes the arm to pause — a safety stop, a perception failure, a planning delay — could be misinterpreted as a phase transition and trigger premature gripper closure. This is a failure mode that would not show up in benchmark success rates but could cause catastrophic failures in production. Anyone deploying VLA policies should test behavior under paused/stalled conditions.

6. Overlooked Insights

The VLM Encodes Target Object Position Per-Patch, Not as a Global Map

Buried in Appendix B (Figure 36), the paper shows that the VLM's representation of the target object is not a workspace map — it's a per-patch detection. "One readout shared across all image-patch tokens detects whether an object the instruction does not name is visible in that patch, well above patch-position and patch-color baselines" (Appendix B). Meanwhile, "a readout of table position fit on all visible objects does not track the target as it moves, whereas one fit on the instructed target alone does" (Figure 36, right). This means the VLM is doing object-level grounding per image patch but only maintains position for the instructed target, not a scene-level spatial map. For multi-object tasks or scenes with distractors, this architecture may struggle to maintain spatial relationships between non-target objects — a potential limitation for tasks requiring relational reasoning.

Contact Detection Is Robust to Out-of-Distribution Perturbations — But Phase Is Not

The paper reveals an asymmetry in robustness between two task-structure variables. Contact detection survives off-schedule interventions (early touch, induced slip) with accuracy well above chance (Figure 4b), suggesting the model maintains a genuine contact representation. But task phase does not survive a simple pause — it's inferred from motion cues. This asymmetry means that in deployment, the policy's "understanding" of whether it's touching something is robust, but its "understanding" of where it is in the task sequence is fragile. A robot that stalls mid-transport might correctly know it's in contact with the object but incorrectly believe it should be grasping.