Tencent releases Hy4 model weights with a million-token context window
Read more
TechNode
technode.com

Tencent releases Hy4 model weights with a million-token context window

Tencent announced on Friday the weights of its flagship artificial intelligence model, Hy4, allowing developers to download and implement the model independently. This release follows the initial launch of Hy4 on November 4th and makes the flagship model available under the Apache 2.0 license, which permits both commercial use and modification.

The Hy4 model is capable of understanding text, images, and video, featuring a context window of approximately one million tokens. Its 'Mixture of Experts' language framework contains 770 billion parameters, with 49 billion parameters activated for processing each token.

According to Tencent's statement, this version of the model surpasses the Hy4 preview in areas such as instruction following, long-context understanding, advanced task execution, and scientific research.

The model supports workflows covering graphical user interfaces and command-line tools, as well as frontend development, game design, and office tasks. Tencent provides deployment instructions for vLLM and SGLang, along with resources for fine-tuning and a safety evaluation map. The release of the flagship model followed the separate unveiling of the smaller Hy4 flash model.

Similar stories

Tencent releases weights of flagship Hy4 model under conditional license
Read more
pandaily.com

Tencent releases weights of flagship Hy4 model under conditional license

Tencent has published the downloadable weights of its flagship Hy4 model on November 20, accompanying the release with a new System Card. This release followed the service launch on November 4 and differs from earlier Hy4 checkpoints that were available this week.

The official model card describes a multimodal 'mixture-of-experts' system with a language core containing 770 billion parameters. When activated, 49 billion parameters are used for each text token, and the context window reaches 1,048,576 tokens. The core count does not include the vision encoder, adapter, or DFly2 drafting component.

Tencent provided developers with various starting points for further training or deployment, including the Hy4 instructions, Hy4-FP8, and base Hy4 checkpoints.

Pandaily confirmed receiving a small range of bytes from one of the weight shards in each of the three repositories. However, the company did not download the full checkpoints nor conduct inference.

The deployment documentation contains recipes for vLLM and SGLang using eight-way tensor parallelism; these are significant infrastructure deployments, not proof that the flagship model runs on a standard laptop.

The weights use the Tencent Hy License 1.0, not Apache 2.0. Additional commercial terms apply to operators providing general-purpose remote inference or fine-tuning to third parties. Model-as-a-service operators must obtain separate written permission if their aggregate global gross revenue exceeds $50 million in any consecutive 12-month period, regardless of whether Hy4 generated that revenue, or before using the model in a product or service with more than 100 million active users in any calendar month.

The license excludes end-user workflows with limited functionality and simple relays to independently managed model services from its definition of model-as-a-service. A narrow exception for internal use requires that the model, its derivatives, or outputs are not provided to third parties. Therefore, these thresholds should not be presented as an all-encompassing restriction for every commercial user.

Tencent also notes the filtering of malicious training material for cybersecurity and the conducting of internal security audits by specialists. These assessments come from the issuer and are not independent guarantees that the model cannot be misused. Developers evaluating deployment must still conduct their own assessment of task performance, resource requirements, and security measures.

The practical change lies in access to the flagship model artifacts and the terms governing its use, rather than in a new debut of previously announced Hy4 capabilities in vision and computer usage.

Tencent releases Hy4 flash model weights for local deployment
Read more
technode.com

Tencent releases Hy4 flash model weights for local deployment

Tencent announced the weights of its artificial intelligence model, Hy4 flash, on Wednesday. This release came two days after the model was introduced to users via the company's applications and cloud API. Developers can now download the standard version of the model, its FP8 format version, as well as the base model for further training.

This release aligns with Tencent's previous statement regarding plans to make the model weights publicly available. The Hy4 flash model is capable of processing both text and image input, and its context window reaches one million tokens.

The model has approximately 224 billion parameters, with about 12 billion parameters activated per token. The main goal of Hy4 flash is to improve daily performance in tasks such as document preparation, research, and spreadsheet work. Tencent accompanied the weights with relevant deployment materials, distributing them under the Tencent Hy license.

MiniMax releases open-weights H3-Image model for 16 MP image generation and editing
Read more
pandaily.com

MiniMax releases open-weights H3-Image model for 16 MP image generation and editing

MiniMax has introduced the MiniMax-H3-Image model with open weights. This model is designed for text-to-image conversion and image editing tasks and is part of MiniMax's H3 family.

The release occurred late on November 10th, and the weights are available on the Hugging Face platform. According to MiniMax, this model is capable of generating an image with a resolution of approximately 16 megapixels, sized at 4096 by 4096 with a 1:1 aspect ratio, in under 10 seconds. The company claims this is about five times faster than the market average for such a resolution.

Model Features and Capabilities

According to the model card, one checkpoint file can perform both text-to-image conversion and edit one or more reference images, accepting up to 16 such references. The diffusion transformer has 33.1 billion parameters, uses the H3 architecture but without audio layers, and was distilled to six sampling steps without using a classifier-free guidance. The model's text encoder is a separate component—the MiniMax-H3 text encoder.

MiniMax indicates that output dimensions can reach 6272 by 2688 without using an upscaler. The BF16 format file weighs 68.65 GB, and the additional prompt extension model, named MiniMax-H3-Image-PE, is 17.9 GB.

The company states that the model's instruction following is the strongest among open-source image models, and it avoids the characteristic 'artificial intelligence' look. These statements are the company's own claims, and no independent comparisons were present in the original material.

The model card recommends using SGLang, vLLM-Omni, diffusers, and ComfyUI for local deployment, and also lists NVIDIA and AMD accelerators. The model is also available via API and MiniMax applications, and for the first week, the company is offering a 50% discount on API requests for 16MP and higher resolution images.

Licensing Terms

The license applied to the model is called the MiniMax-H3-Image Community License Agreement, and it is not a standard open-source license. This agreement is valid worldwide, except in the European Union, the United Kingdom, South Korea, and the United States, stipulating that use outside this territory is not sanctioned by the agreement. Furthermore, it requires obtaining separate written permission from MiniMax for users whose annual income exceeds 1 million US dollars, or for those who provide hosting services to third parties. Commercial products are also required to display the inscription 'MiniMax-H3-Image' in their interface.

This release followed an earlier release by MiniMax of open weights for video and audio based on the H3 model.

Popular