UBTECH introduces Thinker-WM—a world model that unifies video, depth, and robot actions
Read more
Pandaily
pandaily.com

UBTECH introduces Thinker-WM—a world model that unifies video, depth, and robot actions

UBTECH has unveiled details of Thinker-WM, a world model developed by its Thinker team. This model is capable of encoding RGB video, metric depth, and robot actions into a single unified representation. Technical documentation for this development is available on arXiv.

According to the company's statements, Thinker-WM ranked first in three embodied world model benchmarks. These rankings are based on results available at the time of the announcement.

Model Testing Results

According to UBTECH, the Thinker-WM model achieved an overall score of 0.740 on WorldOlympiad. This benchmark is built on real-world robot interaction data and covers over ten robots and several camera configurations. Furthermore, the model reached the highest individual scores for 3D consistency (0.531) and interaction accuracy (0.765).

On the EWMBench platform, the model demonstrated a cumulative score of 4.66, surpassing models such as Qwen-RobotWorld and Sora 2, with leading results achieved in the dynamics and trajectory matching metrics. On the WorldArena 1.0 Track-1 simulation benchmark, the company claims it led across 12 different evaluation criteria.

Architecture and Operating Principle

The main argument for developing Thinker-WM is that many existing world models consist of separate components: video generation handles pixels, the policy network handles actions, and a separate module predicts geometry. UBTECH believes this approach separates physically related signals. Instead, Thinker-WM passes each modality through its own encoder into a common latent space and jointly models them within a Unified Dynamics Transformer before decoding video, depth maps, and executable actions. Depth is treated as an integral output signal, not an auxiliary one.

In single-task experiments on RoboTwin, adding depth increased manipulation success by 15 percentage points compared to the baseline model where depth was absent.

Because all modalities utilize a single set of weights, the model can function in six different modes, including joint video and action generation, future prediction, policy inference, video-to-action translation, and inverse dynamics, simply by changing the input data and generated outputs.

Training Data

The total volume of training data amounts to approximately 30,000 hours. Of this, about 20,000 hours consists of first-person video shot in home environments, retail stores, and factories; about 10,000 hours comprises real robot data from various types; and about 1,000 hours is simulation data. All robot actions are represented as end-effector poses with a body-specific tag, allowing different machines to use the same generation space. A data pipeline called Data Factory handles sampling, multi-level quality checking, and depth-video alignment.

To verify whether the shared space truly connects the modalities, the team trained a small test motion mechanism on frozen visual features to recover end-effector offset, which UBTECH presents as evidence of cross-modal binding.

Similar stories

Visincept, Zhongguancun Academy, and Xiaomi Win in Three Tracks of WorldArena 2.0 at IROS 2026
Read more
pandaily.com

Visincept, Zhongguancun Academy, and Xiaomi Win in Three Tracks of WorldArena 2.0 at IROS 2026

The final results of the WorldArena 2.0 competition, held as part of IROS 2026, demonstrated that various approaches to world model construction successfully handle different types of tests. WorldArena is a benchmark developed by the Tsinghua University team in collaboration with universities from China and other countries. Version 2.0 expanded functionality from visual input to visuotactile, from offline to online reinforcement learning tasks, and from simulation to working with real robots, according to Leiphone.

The competition included three independent tracks with a total prize pool of $7,000 USD, and the final results were published on September 16.

Results of the First Track

The first track assessed the model's ability to predict videos based on 15 metrics across 70 tasks. These tasks included 50 scenes within the distribution on white tables and 20 scenes outside the distribution with colored or textured surfaces. Among 81 ranked models, Visincept's WorldIncept model took first place with a score of 72.33, surpassing BWM-Turbo from the Spatial Intelligence team at Tongji University with 71.49. The difference was only 0.84 points. WorldIncept showed better results in adherence to physical laws, 3D accuracy, and semantic consistency, while BWM-Turbo led in background coherence and JEPA similarity. Visincept clearly utilizes the JEPA approach.

Zhongguancun Academy's Victory in the Second Track

The second track, presented this year, used a world model as an environment for online reinforcement learning in a bottle regulation task on the RoboTwin 2.0 robot, after which the trained policy was tested in simulation. The MW2 model from Zhongguancun Academy won with a score of 72.93 among 47 models, beating TTWM, which is a competitive version of a causality-oriented world model based on JEPA from another startup. The second-place team noted that training in their model increased the success rate of the pi0.5 policy from 55.46% to 72.40%.

Xiaomi Wins in the Real Robot Track

The third track, also new, was conducted on real robots AgileX with two arms and Franka Panda. Its tasks, including visuotactile operations such as chip picking, cucumber cleaning, and fork insertion, as well as vision-only tasks such as wiping tables, pouring water, and folding clothes. The ViTacX model from Xiaomi's MiRobot team achieved overall victory with a score of 76.64. Its advantage was due to the vision-only sub-ranking, where it topped the list with a result of 85.00, including perfect scores in three tasks. In the visuotactile task sub-ranking, it placed third with 66.67, while OmniFlow from Shanghai Technological University took second place in both sub-rankings.

Organizers emphasized that participation in each track was voluntary, so it has not yet been demonstrated that any single model surpasses the others simultaneously in video generation, policy learning, and real robot manipulation.

Popular