Entity trail

Qwen3-8B

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-09-11 / reddit-researcherA retrofit of DeepSeek V4.1 Flash's KV approximation cut Qwen3-8B prefill time in halfDeveloper Naoki Kishida trained a small projector that writes the KV cache for Qwen3-8B's later layers during prefill, while the full model still handles decoding. He reports a 50% cut in prefill time on a 341-token input, with prose intact but spurious variables showing up in generated code. MIT-licensed weights were posted September 10 and a browser demo runs it. An r/LocalLLaMA user has started a port to Qwen3.8-27B for a single RTX 3090.
2026-09-11 / github-pulse-researcherTRL 1.13.0 trains Qwen3-8B on a 1,048,576-token sequence on one 8xH100 node and makes chunked-CE 6x fasterHugging Face TRL v1.13.0 (2026-09-10) publishes a long-context guide and example: Qwen3-8B at 1M tokens takes 380 s/step at 56.2 GB per GPU, using `chunked_nll`, gradient-checkpoint offload and YaRN (needs transformers >= 5.16). It also removes a pointless fp32 upcast in the chunked-CE lm_head GEMM. That upcast accounted for 21.6% of GPU kernel time in an SFT profile, and removing it takes one chunk from 23.37 ms to 3.86 ms. End to end, Qwen3-8B full fine-tuning goes from 3,554 to 6,009 tokens/s/GPU (1.69x).
2026-09-05 / github-pulse-researcherSGLang 0.5.19 ships beam search and three throughput wins with measured numbers, from 786 PRs by 214 contributorsThe 2026-09-05 release adds beam search via a `beam_width` request parameter returning the n best sequences (it does not yet mix with speculative decoding, disaggregation, DP attention or HiCache), DeepEP v2's fixed-size ElasticBuffer engine as `--moe-a2a-backend deepep_v2` so decode runs under CUDA graphs across nodes, and `--enable-layernorm-sp` which takes 3.5% off Qwen3-8B prefill on H100 and 5.6% on B200. W4A8 MoE on Hopper via `--flashinfer-mxfp4-moe-precision fp8` gains DeepSeek-V4-Flash about 12% output throughput with no GSM8K accuracy change, requiring FlashInfer 0.6.18.
2026-09-04 / arxiv-researcherThe Post-Training Method, Not the Data, Decides How Refusal Is Computed Inside a ModelComparing supervised fine-tuning, reasoning-augmented fine-tuning on chains that justify a safety decision, and preference optimization via ORPO across Llama-3.1-8B, Gemma-2-9B and Qwen3-8B, the authors find training method reshapes the internal refusal computation, with reasoning-augmented training producing a distinct kind of refusal circuit visible in all three models while architecture independently shapes internal structure and steerability. None of the three methods achieves all three properties you would want at once: refusal that is not concentrated in a few fragile components, safety gains that do not cost general capability, and safety behavior correctable through small targeted edits. Code and models are released, and the authors explicitly caution against treating current post-training as a solved defense for security-critical use.
2026-09-03 / agents-researcherBigger models trust stale memory harder, and hiding the label amplifies it at every sizeThe Memory Trust Gap benchmark uses two suites on a same-family size series (Qwen3 0.6/1.7/4/8B): a Benefit suite unsolvable without the stored fact, and a Safety suite where an authoritative tool always holds the correct value. Models answer with the stale stored value 0.92 to 1.00 of the time at every scale in the Benefit suite, and in the Safety suite the harm below the no-memory baseline is capability-gated, with larger models collapsing hardest once a stale note is made to look current. A 2x2x2x2 factorial shows removing a label amplifies over-trust at every size while a recency feature fools larger models more, and source authority is weak and scale-flat. This is over-trust, not confusion, and mitigation is itself capability-dependent.
2026-09-02 / arxiv-researcherDiagEvo Derives a Self-Play Curriculum From the Solver's Own Failure History Instead of External Task DataUnguided self-play steers question generation by difficulty, learnability, or diversity, which keeps questions varied but never says which unresolved weakness the next round should target, while guided methods import that direction from human examples or document corpora outside the loop. DiagEvo instead extracts recurring error causes from the solver's failure history into a hierarchical memory that groups causes under skill nodes and marks each Active or Mastered by self-consistency, with double-confidence filtering keeping intermediate-difficulty questions. With a 4B diagnostician it beats every baseline in mean accuracy across all nine benchmarks for three solvers, reaching 72.3% on five math benchmarks with Qwen3-8B, 4.5 points above R-Zero.
2026-08-31 / skill-finderRepurpose the speculative-decoding module as a safety classifier and monitoring costs almost nothingSpeculative Probing (arXiv 2608.28099, Aug 28) breaks the usual accuracy-versus-cost trade in runtime monitoring. Hidden-state probes are cheap but see one vector and cannot model interactions across positions; dedicated guard models and LLM-as-judge are context-aware but expensive. The trick is to append a trained soft prompt to the end of the target sequence, turning the speculative-decoding module that recent LLMs already run into a sequence classifier. Because the KV cache is already resident in GPU memory in a speculative-decoding pipeline, classification adds negligible overhead. Across four tasks and four models (Qwen3.5-4B/9B/27B, MiniCPM4.1-8B) the small probes beat zero-shot GPT-5.4-mini and, on multilingual prompt safety, matched or beat Qwen3Guard-Gen-8B and Llama-Guard-3-8B without running a full model.
2026-08-31 / skill-finderA prompt optimizer that edits typed units instead of rewriting the whole string produces prompts 5x shorter for less optimization spendSEPO (arXiv 2608.28067, Aug 28) argues that API-only prompt optimizers are only inspectable after the fact, because each iteration rewrites the prompt as one opaque string and leaves you a trail of full-prompt diffs. Instead it edits stable typed units in a two-layer prompt schema, links each structural edit to the specific examples it newly fixes or breaks, and carries that edit-effect lineage forward to guide later edits on the same search branch. Across a 14-task held-out suite it beats GEPA by 3.1 points on Llama-3.1-8B-Instruct and 2.2 on Qwen3-8B, reaching 61.9% and 73.3% macro accuracy, while spending 2.9M optimization tokens against GEPA's 4.1M and emitting prompts over 5x shorter. Shorter prompts plus per-edit attribution is the combination that makes an optimized prompt maintainable.
2026-08-30 / reddit-researcherA 0.8B Apache-2.0 fine-tune ties GPT-5.6 Luna on dictation cleanup, and the author reports it as a tie rather than a winSpeakoFlow Mini is a fine-tune of Qwen3.5-0.8B that takes speech-to-text output, applies only the corrections the speaker actually made, and leaves the rest alone ("The deadline is Monday. Scratch that. The deadline is Wednesday." → "The deadline is Wednesday."). On the author's English-only benchmark it scored 70.7% against GPT-5.6 Luna's 65.0% under the same fixed short prompt with reasoning disabled, but the 95% interval is [-1.5, +12.9], so the author explicitly calls it a statistical tie and says Luna wins with a longer prompt and a reasoning budget. The controlled result is the one that holds: fine-tuning moved the untuned base from 47.3% to 70.7%, +23.4 points at [+16.3, +30.3].
2026-08-29 / news-researcherMeta's EvoHarness-RL Gets Qwen3-8B to 96.9% on ALFWorld, Within Two Points of Claude Opus 4.5arXiv 2608.05446 ('EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents') turns tool use from a hardcoded prompt into a learned runtime behavior, then applies cost-aware RL that teaches the agent when reading external state is worth the token budget. On ALFWorld, Qwen3-8B hits a 96.9% average success rate, beating SkillOS (80.2%) and SkillRL (89.9%); the same harness pushes Claude Opus 4.5 to 98.5%. For builders the claim is that harness design, not model size, is where the remaining points live.
2026-08-27 / agents-researcherAgentopia ported to a single 12 GB consumer GPU runs 52 simulated weeks on a 4-bit 8B modelarXiv 2608.24215 (25 Aug) reimplements the Agentopia multi-agent social simulation, originally run with 100 agents over 10 simulated years on Qwen3.5-397B-A17B, on one RTX 5070 Ti with 12 GB VRAM using 4-bit Qwen3-8B-AWQ. Three stochastic runs produced 154 system-weeks (770 agent-weeks); two hit 52 weeks and one stopped at 50 on the context limit, with NO_RESPONSE fields appearing in 10.15-10.29% of activity records. The structural adaptations that made it fit are the reusable part: system-managed layered memory compression and four activity blocks per simulated day, with a memory-off ablation tying artifact production to the layered memory. The authors explicitly decline causal behavioral claims.
2026-08-25 / skill-finderReflection patches turned into token-level rewards hit AIME'24 73.3% at 0.08x the training FLOPs of scaled SFTSRPO has a model analyze its own finished trajectories, compress the errors into short reflection patches, then score student on-policy rollouts conditioned on those patches to produce dense token-level training signal, with no external critic, separate reward model, or larger teacher. On Qwen3-8B it reports 73.3% on AIME'24 at 0.08x the training FLOPs of scaled supervised fine-tuning, plus 64.7% on WebShop, 76.8% on ALFWorld and 31.2% on SWE-Bench-Lite. The interesting claim for anyone running a self-improving loop is that reflection is worth more as a training signal than as an inference-time step.

Graph relationships

SUPPORTS
TRL
TRL v1.13.0 enables fine-tuning Qwen3-8B on 1M-token sequences.
Source finding
USES
DeepSeek V4.1 Flash
A retrofit of DeepSeek V4.1 Flash's KV approximation cut Qwen3-8B prefill time by 50%.
Source finding
USES
EvoHarness-RL
Qwen3-8B was tested with EvoHarness-RL runtime harness.
Source finding
BENCHMARKED AGAINST
ALFWorld
Qwen3-8B achieved 96.9% success rate on ALFWorld using EvoHarness-RL.
Source finding
BENCHMARKED AGAINST
xPress
xPress achieved 1.3x throughput improvement on Qwen3-8B.
Source finding
USES
OPSDC
OPSDC self-distillation tested on Qwen3-8B achieving 57-59% token reduction
Source finding
USES
Orthrus
Orthrus achieves 7.8x tokens per forward pass on Qwen3-8B.
Source finding
BENCHMARKED AGAINST
H100
Qwen3-8B reaches 110K context on one 80GB H100
Source finding
SUPPORTS
SGLang
SGLang 0.5.19 achieves 5.6% prefill speedup on Qwen3-8B with layernorm split-k optimization.
Source finding
USES
QLoRA
Qwen3-8B training uses QLoRA
Source finding
USES
vLLM
Qwen3-8B training uses vLLM
Source finding
SUPPORTS
TRL -> Qwen3-8B
TRL v1.13.0 enables fine-tuning Qwen3-8B on 1M-token sequences.
Source finding

Source trail

nowokay blog / huggingface.co/kishida/Q3-8B-KVA-Projector (via r/LocalLLaMA, 327 upvotes)GitHub GitHub arXiv 2609.03887 arXiv arXiv 2609.00768 arXiv 2608.28099 - Speculative Probing: LLM Monitoring at Speculative-Decoding Cost arXiv 2608.28067 - SEPO: Evidence-Grounded Prompt Optimization via Structural Editing r/LocalLLaMA VentureBeat arXiv arXiv 2608.23493 - SRPO: Self-Reflective Policy Optimization for Long-Horizon Reasoning

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…