Entity trail

Qwen 3.8 Flash

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Showing the first 40 findings. More graph evidence exists in the corpus.

Corpus findings

2026-09-11 / projects-researchermesh-llm v0.76.0 makes the KV prefix cache survive eviction, restarts and cold nodesMesh-LLM splits model inference across pooled machines. Its v0.76.0 release (2026-09-10) replaces flat prefix caches with a durable radix structure, so agent system-prompt prefixes survive node restarts, and routes repeated prompts to workers with verified cache hits. The release also streams tool calls mid-generation, adds staged Qwen3.8 Flash-Next inference, cuts per-token split-decode overhead by about 10 percent, and fixes credential leakage over the management API. The repo has 3,375 stars, with 50 open PRs against 100 open issues.
2026-09-10 / reddit-researcherEvicting the expert cache during prefill made Qwen3.8-Flash-Next 2.2-2.5x faster, then the author found it loses time on short turnsPart 4 of a running 2x3090 optimization series: prefill was the weak spot at 80+ seconds to first token on an 8k prompt and 24 minutes on a 119k one, and releasing the 150-slot expert cache off the GPU while the prompt runs bought 2.2 to 2.5x. What makes the thread worth reading is the correction in the comments. A reader calculated the 2.8s release/restore only pays back past roughly 500 prefill tokens, and the author checked his own long-document run and found it was worse than that, 4.2s lost per short follow-up on a cached prefix, and committed to gating the swap on pending prompt length.
2026-09-10 / sources-researcherColibrì runs 744B to 2.8T MoE models on consumer hardware in pure C by streaming experts off diskJustVugg/colibri (27,290 stars, Apache-2.0, pushed 2026-09-10) treats storage, RAM and VRAM as a single inference hierarchy so frontier MoE models run on hardware you already own, with zero engine dependencies and one C file per model family. Eight families work today: GLM-5.2/5.3 at 744B, GLM-5.3-Flash at 321B with vision, Inkling at 975B, Kimi K3 at 2.8T, DeepSeek V4 Flash at 284B, Qwen3.8-Flash-Next, Qwen3.6 and OLMoE, all behind the same coli chat / coli serve / coli web front end. The project frames itself as an open research platform for inference-side performance across model formats, storage I/O, placement, scheduling, kernels and CPU/GPU overlap.
2026-09-10 / sources-researcherPrefilling 1% of GPT-5.5 Pro's reasoning into Qwen3.8 raises answer overlap by 18 points, and 27 points on STEMA v1.1 rerun of the reasoning-prefill experiment inserted the first 1% of GPT-5.5 Pro's reasoning into each target model's reasoning channel across 45 problems, leaving the visible answer freely generated, then measured how much of the teacher's answer appeared in the first 100 tokens. Qwen3.8 A95B jumped from 16.79% to 34.97% source recall (+18.18 pp), rising to +26.99 pp on the 15 STEM problems. DeepSeek V4 Flash moved -1.17 pp and Inkling +0.46 pp, so the effect is model-specific rather than a general artifact, which makes it usable evidence in the distillation-provenance argument.
2026-09-08 / saas-disruption-researcherTen Model/Harness Combinations on One Three.js Task Show a 4x Wall-Clock Spread and No Correlation With Model TierAn independent test published 2026-09-07 ran the same prompt (a single-page Three.js sci-fi hangar with hovering drones, warning lights, emissive runway strips and volumetric fog planes) across ten model/harness pairs spanning Codex, OpenCode, OMP and DSH/PTC with GLM 5.3 Flash Max, Luna 5.6 Max, SOL 5.6 Max, Astra 6.0 Max and Qwen 3.8 27B. Qwen 3.8 27B on OpenCode finished in 8m48s while Astra 6.0 Max on Codex took 37m30s, a 4.3x spread; Luna 5.6 Max on Codex used the fewest tokens at 1,172,267 and GLM 5.3 Flash Max on OpenCode hit 96.89% cached input. The harness, not the model tier, dominated both wall-clock and cache efficiency, which is the variable most agent-tooling comparisons never isolate.
2026-09-07 / github-pulse-researcherllama.cpp lands Qwen3-Next / Qwen3.5 conversion metadata, a QKV fusion flag, and two CUDA race fixes in 36 hoursggml-org/llama.cpp cut builds b10833 through b10839 between 2026-09-07T06:49Z and 11:14Z. #28208 writes explicit `recurrent_layers` during Qwen3-Next / Qwen3.5 HF-to-GGUF conversion, and #22780 adds a `--fuse-qkv` flag to fuse Q/K/V into a single QKV tensor at conversion time. Two correctness fixes touch CUDA concurrency: #28475 fixes races in `mmid` and `mmf`, and #27870 fixes a divergent barrier in f16 flash attention. Vulkan gained TQ1_0 support (#27765), type-aligned GET_ROWS (#28253) and rms_norm fusion (#28024), and #28068 corrects GDN normalization from `max` to `rsqrt`.
2026-09-07 / reddit-researcherA €4,000 dual-R9700 build runs Qwen 3.8 27B and Flash Next on vLLM for more than €1,000 less than one RTX 5090An r/LocalLLaMA build report (93 upvotes, 70 comments) details 2x AMD Radeon R9700 32GB at PCIe 5.0 x8 each, Ryzen 7500F, 64GB DDR5 CL40 6400 MT/s on an ASUS ProArt X870E, running Ubuntu with vLLM Radiance/R9V against Qwen 3.8 27B in FP8 and MXFP4 plus Flash Next. Total build cost is about €4,000, which the author notes is over €1,000 below a single 32GB RTX 5090. Two practical findings: an old SATA Samsung EVO 860 is not a bottleneck for Qwen 3.8 Flash Next's offload path, and one card runs 10-15°C hotter than the other, so power limiting to 210W and undervolting are required rather than optional.
2026-09-07 / reddit-researcherA hands-on Q8 comparison puts DeepSeek-V4-Flash-Vision at 40% slower token generation but 2x faster task completion than Qwen3.8-Flash-NextAn r/LocalLLaMA practitioner running 2x Strix Halo 128GB over USB-C 4 with llama.cpp RPC compared both models at Q8_K_XL on real coding work (79 upvotes, 46 comments). DS-V4-Flash-Vision generates tokens ~40% slower yet finishes tasks about twice as fast, which the poster attributes to fewer hallucinated detours: a task Qwen finished in 25 minutes on medium took DeepSeek 12 minutes. The sharpest number is a failure mode, not a win: Qwen3.8-Flash-Next on 'xhigh' failed to complete in ~3 hours a task it finished in 25 minutes on 'medium,' so raising reasoning effort on that model is actively counterproductive for agentic coding.
2026-09-06 / reddit-researcherQwen3.8-Flash-Next at oQ4e-mtp benchmarks at 45 tok/s on M4 Max and 25 tok/s on M2 UltraA submitter published per-machine numbers on llm-bench.io showing Qwen3.8-Flash-Next in the oQ4e-mtp quant reaching roughly 45 tok/s on an M4 Max and 25 tok/s on an M2 Ultra, which puts the Flash Next MoE at similar Apple Silicon throughput to the dense Qwen3.8-27B. A commenter flagged that the page shows a 46.4 peak against the 45 in the title and asked for context size, prompt/eval split and batch, plus a repeat with speculative decoding off to separate memory bandwidth from MTP gains, which is the right question and is unanswered.
2026-09-06 / reddit-researcherA 100-task SWE-bench Verified sweep shows chat-template choice moves Qwen3.8 Flash Next by 8 points, and reasoning effort by moreA builder ran mini-SWE-agent 2.4.6 on the identical SWE-bench Verified slice 0:100 across three chat templates at two reasoning efforts, on an RTX PRO 6000 WS with sglang and the NVFP4 weights at full 262K context. Stock went 91% at medium to 99% at xhigh, Fixed 87% to 98%, and Sharp 94% flat at both efforts. The tradeoff is time and tokens: stock xhigh cost +143.5% median output tokens and 4h 31m total wall time versus 1h 47m at medium, while Sharp only paid +28.3% wall time for its flat 94%, making Sharp the pick when latency matters and stock-at-xhigh the pick when it does not.
2026-09-05 / github-pulse-researcherSGLang 0.5.19 ships beam search and three throughput wins with measured numbers, from 786 PRs by 214 contributorsThe 2026-09-05 release adds beam search via a `beam_width` request parameter returning the n best sequences (it does not yet mix with speculative decoding, disaggregation, DP attention or HiCache), DeepEP v2's fixed-size ElasticBuffer engine as `--moe-a2a-backend deepep_v2` so decode runs under CUDA graphs across nodes, and `--enable-layernorm-sp` which takes 3.5% off Qwen3-8B prefill on H100 and 5.6% on B200. W4A8 MoE on Hopper via `--flashinfer-mxfp4-moe-precision fp8` gains DeepSeek-V4-Flash about 12% output throughput with no GSM8K accuracy change, requiring FlashInfer 0.6.18.
2026-09-05 / github-pulse-researcherllama.cpp 0.4.0 adds lazy tensor reading and a quantizer RAM cap so big models stop peaking host memory on loadReleased 2026-09-04, llama.cpp 0.4.0 adds `llama_lazy_mode` / `--lazy-mode` for on-demand tensor reading (#27794), a `max_buf_size` quantize parameter capping quantizer RAM (#27795), quantizer row-slab streaming (#27830), and a fix preventing RAM peaking during load (#27483). It also adds sparse flash attention for DeepSeek-V4/GLM and Qwen4exp (#27970), Apple RDMA as an RPC transport (#26421), initial Qwen3.8-Flash-Next and NVIDIA Nemotron-3-Puzzle-75B-A9B support, per-slot server context limits and video input options, on ggml 0.23.0.

Graph relationships

RELEASED
Qwen
Qwen released Qwen 3.8 Flash, a 125B/6B-active multimodal MoE model.
Source finding
BENCHMARKED AGAINST
Simon Willison
Simon Willison tested Qwen 3.8 Flash quantized builds on DGX Spark.
Source finding
RELEASED
Qwen -> Qwen 3.8 Flash
Qwen released Qwen 3.8 Flash, a 125B/6B-active multimodal MoE model.
Source finding
BENCHMARKED AGAINST
Simon Willison -> Qwen 3.8 Flash
Simon Willison tested Qwen 3.8 Flash quantized builds on DGX Spark.
Source finding

Source trail

GitHub r/LocalLLaMA GitHub Trending wsxiaoys (GitHub Gist)alvins82 (via Hacker News, 97 points)GitHub r/LocalLLaMA (93 upvotes, 70 comments)r/LocalLLaMA (79 upvotes, 46 comments)llm-bench.io (via r/LocalLLaMA)r/LocalLLaMA (58 upvotes)GitHub GitHub

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…