The Chinese artificial intelligence startup VUI Labs has attracted the attention of the global voice technology market by releasing the Luna-TTS model. This system immediately achieved high rankings in authoritative benchmarks: it became the leader in TTS Arena on the Hugging Face platform, surpassing ElevenLabs, MiniMax, and Cartesia, and also secured third place in Artificial Analysis's Speech Arena, ahead of Google.
The company's concept spans from high-precision speech synthesis to creating a multimodal, full-duplex voice agent, which shares similarities with the research direction of Thinking Machines Lab.
Luna-TTS differs from the traditional autoregressive paradigm. Since human speech includes emotions, timbre, and breathing, and the AR architecture forces sequential generation, this leads to increased latency and error accumulation. Instead, Luna-TTS encodes sound into discrete tokens and uses a diffusion language model based on Qwen3 for parallel prediction of voice token batches with real-time streaming capability.
A technical report demonstrated first place in four voice quality metrics in Seed-TTS-Eval, outperforming ByteDance Seed, MiniMax, Zhipu, and the Qwen series, as well as first place in CV3-Eval for error correction and noise robustness, achieving six top spots overall.
The model's technical stack is highly complex. Luna-Codec utilizes an eight-code architecture at 24 kHz and a frame rate of 25 Hz. Semantic information is fixed in the first codebook via the WavLM semantic distillation loss function, while codebooks two through eight fix timbre, channel, emotion, and prosody. The team implemented GRPO reinforcement learning after training on a non-autoregressive discrete masked diffusion model.
For real-time scenarios, Luna-TTS Realtime generates speech in blocks of 1.28 seconds, using 8 to 16 parallel noise reduction steps. This achieves a first-packet latency of 41.6 milliseconds on two H20 GPUs and a real-time factor of 0.024, which is more than 40 times faster than real time.
The model's expressiveness is ensured by deep data work. The team created a multilingual corpus of one million hours, 43.4% of which is Chinese, 43.1% is English, 13.6% is Japanese and Korean. For fine-tuning, about 100,000 hours of top-quality material were selected, and expressive data tagged with non-verbalizations such as laughter, sighs, sobs, and coughing were added, fed directly as text prompts, allowing the model to naturally reproduce nuances of breathing and emotion. Voice cloning requires only a few minutes of samples.
Commercially, VUI Labs has developed a three-tier production system: a model API for real-time generation, cloning, transcription, and translation; a creator and developer platform designed for dubbing and multimodal content; and a voice agent platform integrating recognition, language models, tool calling, and generation for end-to-end deployment. The company has successfully implemented its solutions in logistics dispatching, internet insurance, and travel SaaS, serving clients who have conducted over a million real business conversations. According to the company, the voice technology market combined with vision and collaboration is projected to reach between $266 billion and $740 billion by 2030. The research group, comprising nearly 50 people, half of whom hold PhDs, led by Qian Yanmin, a Doctor of Science from Tsinghua and a Cambridge postdoc honored with Wu Wenjun's First Prize in Natural Sciences in AI.