FreeLLMTencent launches Qwen3.8-27B-DSpine-b16 draft model on Hugging Face
The new five‑layer draft model adds parallel token generation for Qwen3.8‑27B with improved benchmarks and open‑source tooling.
Tencent released Qwen3.8-27B-DSpine-b16 on Hugging Face, a five‑layer draft model for the Qwen3.8‑27B base.
The model uses a block size of 16, an 8,192‑token sliding window and supports up to 4,096 new tokens per request.
Benchmarks show DSpine outperforms DFlash2 and autoregressive decoding, e.g., GSM8K scores rise from 5.69 to 7.20 and throughput gains reach 2.71× over AR.
Installation requires cloning the DSpine repository and running a pip install, then serving with SGLang using the provided command line options.
No inference provider currently hosts the model, and it is available under an Apache 2.0 license with 1,464 downloads last month.
Cosa significa per te
The open release lets developers experiment with speculative decoding without waiting for commercial services. For users seeking free or locally run models, the draft model offers a way to speed up generation on compatible hardware while remaining fully open source.
Fonti
- Tencent releases Qwen3.8-27B-DSpine-b16 on Hugging Face, Hugging Face trending (official), 7 Nov 2026
Scritto automaticamente dalle fonti sopra, poi controllato dal nostro codice: ogni numero e nome deve comparire, e nessuna frase può copiare una fonte. Hai trovato un errore? Segnalalo.
Quale AI puoi usare gratis oggi?
Tutti i modelli AI gratuiti, classificati da voti umani anonimi, con la memoria e la velocità necessarie sulla tua GPU.