Unitree introduces UnifoLM-WLA-1.0, a foundational model for humanoid robots
Read more
Pandaily
pandaily.com

Unitree introduces UnifoLM-WLA-1.0, a foundational model for humanoid robots

On September 10th, Unitree introduced UnifoLM-WLA-1.0, which is a generative foundational model for next-generation humanoid robots with approximately 6 billion parameters. According to the company's statement, a single control file trained on data from a real robot spanning about 2500 hours can coordinate 64 tasks, covering 10 whole-body manipulations and 54 tabletop manipulations, as well as operate with both two-fingered grippers and multiple dexterous five-fingered hands.

This release differs from the previous demonstration of Unitree UnifoLM-X2 sparring; UnifoLM-WLA-1.0 represents a broader 'vision-language-action' stack for performing daily household and tabletop tasks, rather than a combat-oriented demonstration.

Architecturally, UnifoLM-WLA-1.0 is based on interaction-centric world modeling augmented by an MMDiT action expert. This embodied reasoning stage, named UnifoLM-ER-1, is built upon Qwen3-VL-4B and was trained on over 5 million embodied samples. These samples cover aspects such as point prediction, object detection, multi-image reasoning, 2D trajectories, 3D detection, and answering spatial questions, enhancing spatial perception while jointly training with general image and text data to maintain broad 'vision-language' skills.

Furthermore, dynamic region prediction utilizes optical flow to extract future scene changes, compresses them using VQ-VAE into fixed-length mask tokens, and trains the 'vision-language' model to predict which regions will start moving after interaction begins. Discrete action learning via residual vector quantization segments the unified action space into end-effector poses, arm joints, and lower body joints, aligns these tokens across common time steps, and feeds them into UnifoLM-ER-Flow. The WLA model they released includes the MMDiT expert for decoding continuous robot actions from this multimodal framework.

In spatial and embodied reasoning tests conducted on 16 multimodal datasets, Unitree reports that UnifoLM-ER-1-4B outperforms open models in seven benchmarks. Additionally, on overlapping spatial datasets, it surpasses the locally proprietary GPT-6 Astra in metrics such as Where2Place, BLINK spatial subtasks, CV-Bench, and EmbSpatial. Training relies on Unitree Open Datasets and BitRobot-HIW-500, as well as other real robot data sources. Video evaluations are demonstrated on Unitree G1 hardware performing tasks like folding towels, packing phones, making beds, sorting shoes, and cleaning bathrooms—tasks requiring coordinated movement of arms, end-effectors, and lower body within a single policy.

It is important to note that the project page is available to developers, but the code, models, and datasets are currently marked as 'Coming Soon.' Unitree has announced its intention to make the project open source and published documentation on the architecture and task matrix, but the weights and data corpora are not yet available for download. Until these resources become available, the practical signal for researchers and integrators is the disclosed roadmap of the general humanoid foundation and the benchmark table, rather than a ready-to-run control file for third-party robots.

Similar stories

AgiBot introduces GE-Act 2.0 model with 100x data scaling
Read more
pandaily.com

AgiBot introduces GE-Act 2.0 model with 100x data scaling

AgiBot has released GE-Act 2.0—a native, world-class model trained exclusively on embodied manipulation data, rather than being adapted from an existing video generator. The company asserts that this release represents the first systematic investigation into the possibility of a world-class model unlocking new skills for real robots as training hours increase by two orders of magnitude—from approximately 300 hours to 30,000 hours—without requiring fine-tuning for a specific task or using demonstration clips during evaluation.

Unlike existing systems that attach an action head to a frozen video model, GE-Act 2.0 simultaneously trains visual representation, future prediction, and action prediction on robot data. During scene testing, backgrounds, lighting, and object instances are excluded from the training process. Within this zero-shot protocol, covering 100 atomic tasks and about 20 skill families across two embodiments, success rates increased with the volume of data: on the G1-OP platform, overall success rose from 17.1% to 44.1%, and on G2-90D—from 13.4% to 31.1%, with the gain remaining noticeable between the 5,000 and 30,000-hour levels.

The company highlights the 'ignition' phenomenon for fine skills. Tasks showing non-zero success expanded from 39 to 76 on G1-OP and from 24 to 72 on G2-90D. Actions such as folding a towel, placing paper cups, removing and replacing pen caps, and arranging a bouquet in novel scenes only began to reliably manifest after reaching the largest data level. Cross-embodiment transfer was also observed: G1-OP provided over half of the training data, while G2-90D accounted for less than 2%, yet the rarer body still gained about 17.7 percentage points as total data grew.

Architecturally, the CoAE visual encoder compresses each 256x384 frame into 24 tokens while preserving semantic, motion, and local structural cues. A one-step visual planner predicts a full future segment, and a reverse dynamics model translates the predicted change into actions; AgiBot notes that this takes about 104 milliseconds per action chunk on an RTX 5090. The Knowledge-Aligned Selective Optimization method selects several future scenarios and retains the one that best matches the recorded actions to reduce the discrepancy between planning and action.

The data recipe involves mixing incomplete streams: hours of video instructions for pre-training the world model (including egocentric frames without action labels), trajectory hours for reverse dynamics, which include failures and rollouts, and fully paired hours of video instructions and actions for joint training. In AgiBot's GE stack, GE-Sim is aimed at policy evaluation and environment construction, while GE-Act translates predicted future states into robot movement. After optional fine-tuning, AgiBot reports a score of 60.52% in out-of-distribution RoboTwin tests and 0.770 in GenieSim instruction following, surpassing several comparable baseline models. Project materials are available at ge-act-v2.github.io.

Popular