Cambricon adapted the DeepSeek-V4.1-Flash model on the vLLM stack
Read more
Pandaily
pandaily.com

Cambricon adapted the DeepSeek-V4.1-Flash model on the vLLM stack

Cambricon announced the successful completion of adapting the DeepSeek-V4.1-Flash model as part of the Day-0 program based on the open inference stack vLLM. This means that the recently released model can run stably on Cambricon accelerators on the same day DeepSeek published the checkpoint.

This announcement highlights the synergy between chip and software: simultaneous availability of the model and the chip, as well as the maturity of Cambricon's approach combining NeuWare and vLLM. This is not a repetition of information about the general availability of the model itself.

DeepSeek-V4.1-Flash represents the smallest variant of the new DeepSeek architectural line. It is a mixture-of-experts model with 552 billion parameters, which activates about 8 billion parameters on the input side and 16 billion on the output side, and also possesses built-in multimodal vision understanding. DeepSeek notes the use of the Causal-Encoder-Decoder structure and aggressive KV cache compression, which reduces HBM requirements by approximately one quarter and SSD requirements by one eighth compared to the previous generation, while the cache size is hundreds of times smaller than the first version.

These memory savings are critically important for accelerator manufacturers who aim to control inference latency, DRAM volume, and storage levels on dense servers that are already straining HBM budgets.

For its part, Cambricon engineers used the Torch-MLU-Ops unified operator library to accelerate structures such as Engram and Compressor, and wrote optimized kernels in BangC for sparse and compressed attention hotspots. Within vLLM, Cambricon reports support for five-dimensional mixed parallelism, covering tensor, pipeline, sequential, batch, and expert parallelism, with communication and computation overlap, low-precision quantization, and prefix and decoding splitting to boost end-to-end throughput. This stack operates on NeuWare, the company's long-term software platform.

Several days ago, Cambricon joined the PyTorch Foundation as a platinum member, taking a seat on the governing board alongside other major hardware and cloud service developers, signaling deeper investments in the open learning and inference ecosystem.

Cambricon now supports Day-0 inference for five major Chinese model lines: GLM, DeepSeek, Qwen, Kimi, and MiniMax, representing Zhipu AI, DeepSeek, Alibaba, Moonshot AI, and MiniMax, respectively. Caixin Global specifically noted the ability to include Cambricon on the same day as an indicator of shortening internal development cycles for models and chips in China—a shift from multi-month closed ports to readiness for launch on public frameworks that are already standardized by operators.

The practical takeaway for cluster operators is co-availability: when a cutting-edge open model is released, Cambricon clients can use the documented vLLM recipe instead of waiting for a closed fork. The next test for the software ecosystem will be whether this Day-0 scheme applies to larger DeepSeek variants and multimodal serving mixtures.

Similar stories

OpenBMB releases MiniCPM5-2B as an open SOTA model for on-device operation with less than 4 billion parameters
Read more
pandaily.com

OpenBMB releases MiniCPM5-2B as an open SOTA model for on-device operation with less than 4 billion parameters

OpenBMB, an open project associated with ModelBest, has introduced MiniCPM5-2B—a dense language model designed for direct on-device operation. This model features approximately 2.52 billion parameters and supports a native context length of 131,072 tokens, distributed under the Apache-2.0 license.

MiniCPM5-2B is the second release in the MiniCPM5 series, following MiniCPM5-1B. It utilizes the standard LlamaForCausalLM architecture, which includes 42 layers with grouped-query attention, employing 16 query heads and 2 key/value heads. This design allows core engines to load the model without requiring custom kernels or code forks.

The non-embedding parameters amount to about 1.98 billion, enabling the model to fit within the sub-4-billion parameter class suitable for hosting on phones, laptops, and edge devices.

When compared on the 34-benchmark dataset from OpenBMB, MiniCPM5-2B achieves an average score of 53.9, surpassing several larger open base models. Among these, Qwen3.5-4B scored 51.1, and granite-4.2-3B scored 42.7. Conversely, similarly sized models like LFM2.5-2.6B and Qwen3.5-2B lag behind.

The model's strengths are concentrated in areas such as coding agents, tool usage, and long-context information extraction. For instance, on LiveCodeBench v6, MiniCPM5-2B achieved 69.1 compared to 56.4 for Qwen3.5-4B, and on SWE-bench Verified, it reached 46.4 versus 33.6. High results were also obtained on τ²-Bench Telecom (97.1), BFCL v4 (66.6), and NoLiMa (68.1 versus 43.5).

In tasks requiring deep knowledge, performance remains closer to the upper limit of its size; for example, on MMLU-Pro, the model scored 70.8, while the benchmark 4B Qwen model achieved 78.0. OpenBMB specifically notes rows sourced from Artificial Analysis to allow users to distinguish between vendor data and third-party results.

The post-training process followed the UltraData level management: initially, supervised fine-tuning was conducted based on deep reasoning using approximately 400 billion tokens. Subsequently, specialized reinforcement-learning teachers for mathematics, code, agents, and writing were applied using the critique-based JustRL II algorithm. The final stage involved on-policy distillation, which merged 16 RL experts—five of which were agentic—into a single final student model.

OpenBMB attributes the average gain of about 10.96 points in reasoning and general benchmarks, along with 6.96 points in agentic benchmarks, to the RL and distillation stages. To allow for precise measurement of each component's contribution, the company releases intermediate checkpoints: Base, Midtrain, and SFT-only.

Along with the weights, UltraData publishes datasets covering web, code, mathematics, SFT, and RL samples for agents, enabling result reproducibility. Runtime support includes vLLM, SGLang, Transformers, llama.cpp, Ollama, LM Studio, MLX, LiteRT, and multi-chip FlagOS builds. Packages in GGUF, MLX, and GPTQ formats are provided for local assistants that need to perform tool calls and handle long context without relying on datacenter GPUs.

For developers focused on on-device deployment, MiniCPM5-2B is positioned not so much as a general knowledge giant, but rather as a compact Apache-licensed agent and coding companion that already surpasses some open 4B class base models based on published average scores.

Local Model StartLux with 27 Billion Parameters Surpasses DeepSeek V4 Flash in Chinese AI Benchmark
Read more
pandaily.com

Local Model StartLux with 27 Billion Parameters Surpasses DeepSeek V4 Flash in Chinese AI Benchmark

According to a report prepared by the China Academy of Information and Communications Technology (CAICT), a new player has emerged on the map of local models. The company StartLux, based in Shanghai and having developed the StartLux-V1.0-27B-Preview model, secured second place overall in the specialized MCP test within the lineup of verified AI benchmarks, surpassing DeepSeek-V4-Flash using only 27 billion parameters.

The MCP test evaluates six specialized tasks: location navigation, internet search, browser automation, financial analysis, code repository management, and 3D design, and also includes a comprehensive assessment focusing on coordinating multiple tools, performing complex tasks, and interacting in real-world scenarios. Among the tested models were DeepSeek-V4-Pro (1.6 trillion parameters), DeepSeek-V4-Flash-0731 (284 billion), Step-3.7-Flash (198 billion), StartLux-27B-260715 (27 billion), Qwen-3.6-27B (27 billion), and AgentCPM-Explore (4 billion).

The StartLux-V1.0-27B-Preview model achieved a score of 39.25, earning it second place, overtaking both DeepSeek-V4-Flash with 284 billion parameters and Step-3.7-Flash with 198 billion. With the same parameter size, it outperformed Qwen-3.6-27B by 5.34 points. The model ranked first in location navigation and also achieved first place or tied for first in browser automation and financial analysis, sometimes reaching the level of the trillion-parameter DeepSeek-V4-Pro model.

This model is built upon Qwen3.6-27B with additional post-training enhancements. StartLux implemented an approach they termed 'AI trains AI' (Automatic Search), which allows for autonomous experimental training and strategy refinement through feedback. The company claims this is the first application of this method for a local agent model in China.

This result reflects a broader shift in the industry. As the performance of cutting-edge models reaches practical thresholds, the era of the parameter race is transforming into a phase of homogenization; user priorities are increasingly shifting towards solving real problems, ensuring data security, and controlling costs, rather than solely achieving high benchmark scores. Global players are moving in the same direction: Google's Gemma 4, Meta's open Muse Glimmer, and Nvidia's Nemotron 3.5 Lightning are targeting local deployment.

StartLux-V1.0-27B-Preview can run on consumer PCs, and the company plans to release its first generation of local intelligence solutions this year. The CAICT results signal to enterprises that compact, locally deployable models are now capable of competing with much larger cloud solutions in tasks that matter in real workflows, beginning to change procurement decisions.

Popular