The Huawei Ascend computing systems team announced the completion of adaptation for inferencing the Kimi K3.1 Pro model, which has 2.8 trillion parameters. The full weights of this model were released by Moonshot AI on November 4, according to Huawei Computing's official account, as reported by IT Home and ifeng Tech.
Using vLLM Ascend and SGLang, developers can now deploy this model on Atlas 800 A3 servers, in the Atlas 900 A3 SuperPoD cluster, and in the Ascend 950 SuperPoD series since its release.
Kimi K3.1 Pro is the first model in Moonshot AI's K3.1 series. It is a mixture-of-experts model with native visual processing and a context window of about one million tokens, activating approximately 104 billion parameters at each inference step. The model retains the hybrid linear attention K3, based on Kimi Delta Attention (KDA) layers, and adds sparse attention layers DSA instead of some full attention layers to reduce the cost of modeling long context.
Most of the adaptation work was related specifically to this architecture. Huawei stated that its inference team relied on the previous adaptation of Kimi K3, pre-analyzing the new model and working in parallel on model integration, operator development, and service validation. Thanks to existing support for KDA and MoE, the team added a new sparse attention path and multimodal inference while preserving existing serving functions in the inference frameworks.
According to Huawei, the optimization covered core operators for historical information retrieval, sparse attention computations, preprocessing, and residual computations, which were combined with distributed caching and framework-level functions to support long-context inference and production serving. The company aimed for users and developers to be able to start testing applications and deployment on the first day of the model's release.
vLLM Ascend documentation indicates that Kimi K3.1 Pro is supported in experimental mode in version vLLM Ascend 0.30.0. Its reference configurations use prefix and decoding splitting across eight nodes with four prefix nodes and four decoding nodes, including a long-context configuration of one million tokens. Atlas 800I A3 servers operate with the quantized checkpoint W4A8, while 950DT products use the W4A8 MXFP variant; the guide notes that Atlas A2 and 950PR products are not yet supported.
The model size makes hardware support a practical issue. IT Home notes that weights in BF16 format take up about 5.6 TB and still require about 1.4 TB when quantized to INT4, ruling out the use of a single consumer GPU. Huawei positioned its A3 and 950 SuperPoD systems for this class of trillion-parameter MoE inference, and the release of Kimi K3.1 Pro was the last open model it supported on launch day.



