Tencent Hunyuan releases technical report on Hy-Nomas and launches Hy-Nomas-Bench benchmark for world models
Read more
Pandaily
pandaily.com

Tencent Hunyuan releases technical report on Hy-Nomas and launches Hy-Nomas-Bench benchmark for world models

Tencent Hunyuan has presented a technical report on Hy-Nomas, its open model for interactive world generation, and released Hy-Nomas-Bench—a test suite for evaluating interactive world video models. The report was posted on arXiv on October 27, following the initial release of the code and weights on October 21.

Hy-Nomas is a world video model based on an 8-billion parameter diffusion core. Users can control it over multiple iterations using free-form text prompts, continuous camera control, or a combination of both methods. The model generates the world segment by segment, ensuring scene consistency over time by conditioning each new segment on the current input and saved history.

According to the report, the key concept involves aligning structured video captions with causal attention that accounts for actions. Descriptive context remains available between segments, while action-related instructions are applied only to the corresponding time window. A vision-and-language-based prompt enhancer transforms user queries and interaction history into structured conditions for the next segment.

The training process follows a multi-stage curriculum. It begins with causal generation, then moves to text interaction and camera control, after which the model trains on histories it generated itself, concluding with a diffusion distillation step. The distilled model requires only four to eight denoising steps. In human evaluations, the team noted that Hy-Nomas surpassed existing world models.

Hy-Nomas-Bench includes 280 test scenarios covering four tasks: multi-turn free-form text interaction, camera navigation, alternating text and camera control, and spatial memory. This suite tests the model's ability to follow sequential instructions, generate physically plausible responses, accurately execute camera movements, and maintain scene consistency when the camera returns to a previously visited location. The kit includes prompts, structured captions, interaction sequences, and reference camera trajectories, and is released under the Apache 2.0 license.

The model itself is also distributed under the Apache 2.0 license. Tencent provides an INT8 configuration that runs on a single RTX 4090 using a sliding window history and CPU offloading, as well as a Diffusers pipeline, LoRA fine-tuning code, and an interactive web demo. Among the released adapters are a cinematic LoRA and a robotics LoRA trained on real data from a two-armed robot.

Developers outside the ecosystem have already integrated support into SGLang, ComfyUI, and WanGP, and one community demo project reported generating 720p in real-time on Google TPUs.

Similar stories

Amap releases Lambda-0, a humanoid model trained exclusively on first-person human data
Read more
pandaily.com

Amap releases Lambda-0, a humanoid model trained exclusively on first-person human data

Amap, a division of Alibaba Group focused on mapping and geolocation, has introduced Lambda-0. This model is positioned as the first foundational model for humanoid robots, created based on observed human behavior. The research was conducted in collaboration with Alibaba's ATH business group, and the code is available on GitHub under the Apache 2.0 license alongside a scientific paper on arXiv.

The core idea is that a humanoid can learn walking, posture, and two-handed manipulation simultaneously, even if the robot is absent during data collection. The team asserts that many vision, language, and first-person action-based models focus only on hands and limbs, ignoring crucial information about the torso, body, and posture needed for long-term tasks in open environments. Using teleoperation of real robots to fill this gap is costly and slow to scale.

Instead, Lambda-0 utilizes a whole-body data collection method without the robot's involvement, which Amap calls 'robot-free whole-body data collection.' Specialists wear consumer devices and record movements in everyday settings. For a single demonstration task, collecting one segment took about 29 seconds, which is significantly more efficient compared to the approximately 100 seconds required when using a physical robot, demonstrating a 3.4 times efficiency gain. Through this process, the team created the HumanVerse-500 dataset, containing 500 hours of human behavior data in open environments, synchronized across vision, body movement, and hand actions.

The training process occurs in three stages: hand interaction, full-body coordination, and finally, embodiment in a humanoid body. To account for differences between human and robotic bodies, as well as end-effector errors, the model employs a viewpoint alignment scheme and a coarse-to-fine action alignment method while maintaining full-body coordination and improving contact accuracy.

According to the presented paper, Lambda-0 demonstrated state-of-the-art results in the SIMPLE simulation environment, achieving about 90 percent success rate, as well as in real-world robot tests. In seven long-horizon, full-body mobile manipulation tasks, the model successfully transferred its learning to the Unitree G1 using only human data. The team reports a real-robot success rate of 62.5 percent, which is 22.5 percentage points higher than the strongest baseline. With a constant number of robot demonstrations, increasing the volume of human behavior data generally continued to improve performance on the real robot, which the team presents as evidence of the scalability of humanoid training based on human data. These figures are taken from the team's paper and have not yet been independently reproduced. For Amap, the release of this model complements their recent work on 3D city world models.

Tencent releases open version of Hy Memory 2.0 with workflow and code memory for AI agents
Read more
pandaily.com

Tencent releases open version of Hy Memory 2.0 with workflow and code memory for AI agents

Tencent Hunyuan has introduced the second version of its memory framework for AI agents, Hy Memory 2.0, and made all three levels of the stack open source. These levels include a specialized memory model, the framework itself, and a local memory application called MemHub. Users can apply these components either individually or in combination.

Tencent reports that Hy Memory is already being used by internal teams in areas such as finance, news agencies, knowledge management, office agents, social entertainment, and gaming.

The framework is responsible for storing, updating, and developing three types of memory: chat, working, and code. Developers integrate it into their agents via an SDK available on PyPI under the name hy-memory 2.0.2. The new features in version 2.0 are working and code memory. They record the task goal, decisions made, intermediate results, and useful lessons, as well as the conditions applicable to these lessons. Before resuming a long-term task, the system first determines the current task, then retrieves relevant decisions, operational experience, and previous work history.

Chat memory now groups disparate facts into events, indicating time, location, and participants, merges duplicates, and resolves contradictions before passing context to the model.

Framework Testing Results

Tencent stated that it ranked first among open-source frameworks, including Mem0, MemOS, and EverOS, in four different tests. According to the company, working memory showed an average score of 55.31% in trip planning and shopping tasks on the MemoryArena platform. Code memory achieved 64.2% accuracy in question answering and 35.6% task resolution on CodeMemoryBench, as well as 28.3% task resolution on SWE-ContextBench. Chat memory demonstrated 72.6% accuracy on LoCoMo while reducing the number of tokens per question from 1159 to 703, representing a 39.3% decrease.

The layer model, named Hy-Memory-30B-A3B, is a 'mixture of experts' type model with approximately 3 billion active parameters, trained for memory retrieval and conflict resolution. This model is evaluated in a technical report on a fixed sample of 20% of benchmarks across all four memory systems. On this sample, it showed a macro average of 55.49, slightly exceeding the scores of Claude Opus 5 (54.62) and DeepSeek V4.1 Flash (53.64). The model weights are available on Hugging Face.

The MemHub application is a locally oriented tool that includes a command line and a Mac client. After authorizing connected tools, the user imports past sessions into a unified local memory store and supports synchronization of new data. Tencent notes that MemHub is currently integrating with 10 AI tools, including WorkBuddy, Cursor, Codex, Qwen Code, OpenCode, and DeepSeek Harness.

The repository license file on GitHub states that Hy-Memory is released under the Apache 2.0 license.

Popular