Tencent has unveiled Hy4 preview, a new open-source artificial intelligence model focused on programming, research, and financial analysis. This technology will be integrated into the company's existing products, such as CodeBuddy and WorkBuddy.
The model has a total of 770 billion parameters, but only approximately 49 billion are activated during each request. This launch is part of Tencent's expansion in the field of artificial intelligence.
Hy4 preview was made available by Tencent through a publication on the Hugging Face platform, which serves as a repository for open AI models. The architecture employed utilizes the 'mixture of experts' concept.
Although the model contains 770 billion parameters, only a fraction is used per text request. The strategy involves directing different segments of the model according to the specific task, thus avoiding the simultaneous use of the entire structure.
Tencent developed Hy4 specifically to meet the demands of software engineering, research, and financial analysis. The company plans to incorporate this tool into both CodeBuddy and WorkBuddy. It is important to note that the presented version is still in a preliminary stage, and the company itself warned that the system may exhibit undesirable behaviors when processing more elaborate tasks.
This launch occurs at a time of intensified investment by Tencent in the sector. In April, the company had launched Hunyuan 3.0, its first major language model since hiring Yao Shunyu, a former OpenAI researcher, to lead the development of its AI platform.
Hy4 preview adds another option to Tencent's catalog of open-source models. It will remain in the initial phase, being gradually implemented in the company's products as it strengthens its bet on artificial intelligence applications.