The source classifies past methods as 3D-aware World Action Models: they introduce depth, point clouds, or geometric constraints, but their core representation is still built on 2D vision or other latent features. The difference UNITAS claims is that three dimensions are no longer merely auxiliary information but the foundation for the model's understanding of the world—the backbone model directly processes 3D tokens, without using image tokens as a bridge.
Concretely, this claim maps onto the joint modeling of action flow and scene flow. Action flow refers to the motion trajectories of points on the manipulated body, and scene flow refers to the motion trajectories of points in the scene; the two are connected in the same coordinate system, making robot control and world prediction a problem within the same coordinate system. The paper's ablation experiments claim that after adding scene-flow supervision, the performance of the action policy itself continues to improve.
To support joint learning across embodiments and datasets, UNITAS proposes two modules: world-aligned 3D positional embeddings, used to unify 3D coordinate encoding and to complete missing depth within the view frustum, thereby supporting both RGB-D and RGB data; and a physical-time trajectory encoder, which uses FiLM modulation to align trajectories of different durations and frequencies into the same physical-time feature space. The backbone model, Point Dynamics DiT, has both a policy mode and a simulator mode.
An uncertainty must be flagged here: the source only provides ablation results and does not conduct external comparisons, so among the gains brought by the "3D-native" representation itself, how much comes from the representation and how much from data and training strategy cannot yet be separated.