Back to feed
News Story
量子位
1 sources

Tsinghua-backed Robot Era's VPP2 Tops RoboDojo Benchmark, Beating GPT-6-Astra and Others

Robot Era's self-developed World Action Model VPP2 has claimed the top spot on the RoboDojo simulation benchmark with an average success rate of 32.26% and an average score of 39.26, surpassing models like GPT-6-Astra, π0.5, and NVIDIA GR00T-N1.7. VPP2 also ranked first in generalization, fine manipulation, and memory dimensions without using additional data or enhancement methods. In real-world zero-shot tests on an ALOHA dual-arm robot, VPP2 achieved an average success rate of 58.5%, higher than π0.5's 40%.

SynthePulse Insight · AI deep readingMembers

VPP2 Tops RoboDojo: Competition in World Action Models Is Shifting from 'Predicting Well' to 'Getting It Done'

Version 1 · 1 source

VPP2, the world action model independently developed by Xingdong Era and Tsinghua University, took first place on the RoboDojo simulation leaderboard in both overall average success rate at 32.26% and average score at 39.26 points, and in real-robot zero-shot testing achieved an average success rate of 58.5%, higher than π0.5's 40%. But this report card comes from a simulation environment and the team's own evaluation, with no third-party independent reproduction yet, and whether its generalization ability holds up in more real physical environments remains an open question.

  • VPP2 ranks first on the RoboDojo simulation leaderboard in both overall average success rate at 32.26% and average score at 39.26 points, ahead of GPT-6-Astra's 22.48% and 28.97 points.
  • RoboDojo is led by HKU MMLab and co-built by nearly 20 top academic institutions worldwide, containing 42 dual-arm manipulation tasks covering five dimensions: generalization, precise manipulation, long-horizon tasks, memory, and open-vocabulary instruction understanding.
  • VPP2 ranks first in three dimensions: generalization, fine manipulation, and memory; in real-robot zero-shot testing deployed on the ALOHA dual-arm robot, it took best-in-class results in 9 of 10 task categories.
Open section navigationA 'Double First' Report Card, and the Exam Hall It Sits In

A 'Double First' Report Card, and the Exam Hall It Sits In

VPP2, the world action model independently developed by Xingdong Era, has topped the RoboDojo simulation leaderboard, with an overall average success rate of 32.26% and an overall average score of 39.26 points, ranking first in both metrics. For comparison, in the post-training evaluation of the RoboDojo simulation benchmark, GPT-6-Astra had an average success rate of 22.48% and an average score of 28.97 points, with VPP2 leading by 9.78 percentage points and 10.29 points respectively.

To understand this result, one must first understand the exam hall. RoboDojo is led by HKU MMLab and co-built by nearly 20 top academic institutions worldwide; its simulation tests include 42 dual-arm manipulation tasks covering five dimensions: generalization, precise manipulation, long-horizon tasks, memory, and open-vocabulary instruction understanding. Its question design deliberately avoids robots' comfort zones: can it still work after the environment changes, can it still grasp accurately when objects are placed crookedly, and does it still remember what happened earlier when a task is half done.

The two metrics have different emphases: success rate looks at whether the robot can complete a task fully, while average score measures how far a task progressed—even if it was not fully completed, it can still reflect staged performance. Both metrics aggregate test results across the five capability dimensions. Broken down, VPP2 ranks first in three dimensions—generalization ability, fine manipulation, and memory ability—and these three happen to correspond to several hurdles robots face when entering the real world.

It must be made clear that RoboDojo is, after all, a simulation environment. In the physical world, friction, deformation, and positional deviation of objects all introduce variables. Whether the generalization ability shown in simulation holds up on real robots is a question that must be answered separately, beyond this report card.

From Simulation to Real Robot: What 58.5% Means

The team deployed VPP2 on a real ALOHA dual-arm robot to test 10 categories of zero-shot manipulation tasks including grasping, placing, stacking, folding, and pouring—that is, without additional fine-tuning for these test tasks, the robot goes straight to work. The result was an average success rate of 58.5%, higher than π0.5's 40%, and it took best-in-class results in 9 of the 10 task categories.

The significance of this real-robot result lies in the fact that it examines whether capabilities from simulation can transfer to a real physical environment. But the boundary is equally clear: the real-robot test was conducted only on the ALOHA dual-arm robot and did not cover other embodiments; the 58.5% average success rate also means a considerable proportion of tasks still went uncompleted.

Two other generalization tests provide supplementary evidence. LIBERO-Pro examines manipulation ability after changes in object positions and task requirements, where VPP2 had an overall success rate of 45.0% while other baseline models reached at most 11.0%; LIBERO-OOD examines compositional generalization, recombining familiar objects, layouts, and task goals into new tasks never seen before, where VPP2 had an overall success rate of 63.9%.

Putting these results together, the judgment that can be read is this: VPP2 shows leadership across multiple evaluation criteria, but these evaluations all come from tests developed or participated in by its own team, with no third-party independent reproduction results yet.

Free for now

Read the full analysis

5 more sections of analysis, plus the full takeaway

Loading

Credibility boundary

The factual basis of this article comes from QbitAI's report on Xingdong Era's VPP2 (article_id 21396). Among these, the RoboDojo leaderboard results, real-robot zero-shot test results, three-stage training strategy, base model and architecture parameters, latency data, LIBERO series test results, VLM planning improvement data, open-source status, and logistics partnership information are all marked as confirmed facts according to the source; the claim of 'no extra data added and no enhancement methods such as Agent RSI used' comes from report relay, lacks first-party independent verification, and is treated only as a source claim; the judgments that logistics commercialization does not equal scaled deployment of VPP2, and that the model's long-term stability remains to be verified, are inferences based on source information. All leading results come from evaluations developed or participated in by its own team, with no third-party independent reproduction results yet, and readers should understand the relevant numbers against this background.

Primary report

量子位

Primary source