Fetching from the wire…
Top 5 · 2026-08-15 · source-backed
Somebody diffed the configs. Zero architectural changes. Same 64 layers, same 5,120 hidden dimension, same hybrid Gated DeltaNet → FFN / Gated Attention → FFN block structure as Qwen3.6-27B. The r/LocalLLaMA post showing this hit 945 upvotes and 157 comments, and Hugging Face discussion confirms KV-cache behavior is unchanged. r/LocalLLaMA
Alibaba published the weights August 14 at 15:00 UTC under Apache 2.0, a return to permissive licensing after several closed Qwen releases. It's a 27.78B-parameter dense multimodal model with a native 262,144-token context, and it reportedly beats the much larger Qwen3.7-Plus on coding and office tasks. The Decoder
The practical payoff of the identity: your 3.6 quantization recipes, serving configs, and VRAM budgets carry over unchanged. Don't re-derive them. But one thing does not carry over, and it will quietly wreck your output if you miss it. Qwen changed the recommended sampling defaults. Thinking mode uses temperature 1.0, top-p 0.95, top-k 20, presence penalty 0.0. Instruct mode uses temperature 0.7, top-p 0.80, top-k 20, and presence penalty 1.5. r/LocalLLaMA A presence penalty of 1.5 is aggressive. Carrying a 3.6 config forward gives you the identical architecture running on the wrong knob.
The second gotcha is worse. The 1,191-point HN thread on the release is dominated by deployment breakage, not benchmarks. The shipped Jinja chat template is broken. One developer reported agent success rate going from 67% to 92.5% after swapping in a third-party corrected template. Hacker News Twenty-five points of agent success rate, sitting in a template file. If you benchmarked this model on day one and found it mediocre at tool use, you benchmarked the template. Practitioners in that thread also flag KV-cache inefficiency, with 32K of context eating 2.5GB of VRAM, and one user unable to fit 128K even with V quantized to Q4_0.
Two more things happened fast. A decensored variant using Heretic's Magnitude-Preserving Orthogonal Ablation appeared on Hugging Face within a day. The comparable Qwen3.6-27B run reports refusals dropping from 92/100 to 6/100 at a KL divergence of 0.0021 from the original weights. r/LocalLLaMA Safety post-training on open weights now has a shelf life of about 24 hours. And Meta's Muse Glimmer, a 30B Apache 2.0 agentic model released August 10, held the consumer-GPU crown for exactly four days. r/LocalLLaMA
Four days. Pin your infrastructure to a specific local checkpoint and you'll finish evaluating it after it's obsolete. Build the swap path first, the eval second.
Each link below shares sources, entities, or timing with this story.
For about a year, "run your agent locally" meant accepting a model that couldn't reliably call a tool twice in a row. That excuse is gone. Meta Superintelligence Labs published Muse Glimmer today: a 29.6B dense causal transformer, 52 layers, 6,656 hidden dim, with a ~1.8B ViT-...
PR #19378 landed in llama.cpp this week, and I think most people are underselling what it means. Backend-agnostic tensor parallelism via --split-mode tensor makes multi-GPU inference work across AMD, Intel, and Apple Silicon. Not just CUDA. Everything. For context: llama.cpp h...
Moonshot AI dropped Kimi K2.6 today and the numbers are hard to ignore. One trillion parameters total, 32 billion active per token across 384 experts, 256K context window, and native multimodal input. It scores 58.6 on SWE-Bench Pro versus GPT-5.4's 57.7 and Claude Opus 4.6's...
Staged on ModelScope for 23:00 Beijing time August 26, it's roughly 125B parameters plus a separate N-gram embedding table of about 51B, activating 6B per token, with GDN gated-delta hybrid layers and Qwen Sparse Attention. Alibaba frames it as a technology preview of the Qwen...
The Hugging Face page is marked "Upcoming release" with no model card, license, architecture details, context length or benchmarks, after Alibaba promised both Qwen3.8-Max and the 27B weights for the week of August 10. A ModelScope countdown pointed at August 15. Unsloth signa...
The repo appeared August 24, opening the weights of a multimodal MoE that Qwen frames explicitly as an architecture preview, the same role Qwen3-Next played for Qwen3.5 (GitHub). The hybrid Gated DeltaNet plus Gated Attention design it previews already carried through the Qwen...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.