Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-31 · high
The models were the easy part; getting them to run meant forking llama.cpp because upstream never added support.
Why now: The fork requirement surfaced in this r/LocalLLaMA post as of August 31, 2026.
One developer spent a month building uncensored quants for five niche local models, then had to write the runtime code to run them.
None of it runs on mainline llama.cpp. Getting the 1M-context window these releases promise means installing one person's fork instead.
The release covers LongCat-Flash-Lite-Sparse, Qwen3.8-27B, Qwen3.5-122B-A10B with MTPs, Qwen3-Coder-Next, and Laguna-S2.1 with vision support, according to a month of solo work posted to r/LocalLLaMA. LongCat-Flash-Lite-Sparse needed new architecture support in Heretic, the uncensoring tool, before quantization could start. Then came llama.cpp support for that same architecture, written from scratch, since mainline never added it.
Architecture support doesn't ship with the model release. Someone has to write it, and right now that's one person, unpaid, across five models in a month. If they stop maintaining the fork, every GGUF built against it stops working with anything newer.
The post doesn't say whether any of this gets upstreamed to llama.cpp, or whether the author plans to keep maintaining the fork after this release.
Each link below shares sources, entities, or timing with this story.
The repo appeared August 24, opening the weights of a multimodal MoE that Qwen frames explicitly as an architecture preview, the same role Qwen3-Next played for Qwen3.5 (GitHub). The hybrid Gated DeltaNet plus Gated Attention design it previews already carried through the Qwen...
The leaderboard says first place. The methodology says you should check your own bill. Qwen3.8 Max now ranks first on Artificial Analysis' agentic index, scoring 86.1 on OSWorld-Verified ahead of GPT-5.6 Sol Max at 83.2 and Fable 5 at 85.0, priced at $2.00/M input and $6.00/M...
The models are good. The license is the real story. Google released Gemma 4 on April 2 with four variants: E2B, E4B, 26B MoE, and 31B Dense. All built on the Gemini 3 architecture. The 31B Dense variant claimed #3 on Arena AI's text leaderboard, beating models 20x its size. Th...
For about a year, "run your agent locally" meant accepting a model that couldn't reliably call a tool twice in a row. That excuse is gone. Meta Superintelligence Labs published Muse Glimmer today: a 29.6B dense causal transformer, 52 layers, 6,656 hidden dim, with a ~1.8B ViT-...
Unsloth's UD-Q2_K_XL (78.9 GB) plus a 358,400-token slot via YaRN from the native 262,144 with fp16 KV fits under the default 96GB Metal wired limit, no sysctl hack. Cold prefill runs 1,561 t/s at 5.6K context down to 318 t/s at 111K; a normal incremental turn is 77-854 t/s ou...
A Hugging Face repo packages the model with the n-gram lookup table offloaded to SSD and streamed. The credible reply in the thread: a builder on an RTX Pro 6000 running the RAM variant reports over 12k prefill and over 170 tok/s single-stream decode, plus 440 tok/s at concurr...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.