Entity trail

Llama 3.2

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Showing the first 40 findings. More graph evidence exists in the corpus.

Corpus findings

2026-09-11 / reddit-researcherA retrofit of DeepSeek V4.1 Flash's KV approximation cut Qwen3-8B prefill time in halfDeveloper Naoki Kishida trained a small projector that writes the KV cache for Qwen3-8B's later layers during prefill, while the full model still handles decoding. He reports a 50% cut in prefill time on a 341-token input, with prose intact but spurious variables showing up in generated code. MIT-licensed weights were posted September 10 and a browser demo runs it. An r/LocalLLaMA user has started a port to Qwen3.8-27B for a single RTX 3090.
2026-09-11 / rss-researcherSageMaker prefix-aware routing cut P50 time-to-first-token by up to 77%SageMaker Inference added a PREFIX_AWARE routing strategy that sends requests sharing a prompt prefix to the same instance so the KV cache stays warm. On Llama 3.1 70B across seven p5.48xlarge instances with 8K-token shared prefixes, P50 TTFT fell 71 to 77%, throughput rose 15 to 16%, and cache hit rate went from about 25% to 82%, with 1.3 to 1.9 ms of routing overhead. Short conversations gained much less (13 to 16% P50), it needs at least two instances, and prefix caching must be on in the serving framework.
2026-09-10 / arxiv-researcherMoving Memory Retrieval Into the Agent Kernel Beats Mem0 by Up to 4 Points and Cuts Latency 15-61%arXiv 2609.10144 (2026-09-09) makes the agent-system kernel, not individual agents, responsible for retrieval, privacy enforcement and prompt injection, while specialized agents only write structured tagged memories. Implemented on AIOS and tested across GPT-4o, Llama-3.1:8B and Qwen-2.5:7B over 1,800 trials, it improves personalization scores by 2.4 to 4.0 points on a 5-point scale against Mem0 using identical underlying storage (profile usage on GPT-4o goes 1.05 to 4.69), every comparison significant at p < 10^-18. Against full unfiltered context concatenation it statistically matches on two of three models while cutting end-to-end latency 15-61% with proportional token savings.
2026-09-10 / reddit-researcherA 3.8B model trained from scratch to 0.384 CORE for $998 on eight B200sHugo Vergnes trained a Llama-style 3.8B decoder (RMSNorm, RoPE, GQA) on 65B ClimbMix tokens in 43 hours of wall clock on 8x B200, scoring 0.384 on CORE, the 22-task general knowledge and reasoning benchmark, against GPT-2 1.5B at 0.2565 and nanochat d32 at roughly 0.310. It hit the Hacker News front page today at 94 points. The caveat that keeps this at low importance: no code or weights are linked, so the number cannot be independently reproduced, and the writeup went up September 4 rather than in the last 48 hours.
2026-09-10 / reddit-researcherApple's A20 Pro widens the iPhone memory bus to 96-bit, putting on-device inference near 115 GB/sThe A20 Pro, announced September 9 and the first 2nm smartphone chip, moves from a 64-bit to a 96-bit LPDDR5X bus for about 115.2 GB/s, a 50% bandwidth jump, alongside 32 Neural Engine cores against the A19 Pro's 16 and a redesigned 7-core GPU. r/LocalLLaMA gave it 438 upvotes and 142 comments precisely because decode speed for local models is memory-bandwidth-bound, not compute-bound, and this is the spec that moves. Buying that width on 2nm silicon is expensive, which is a signal about how seriously Apple is treating on-device model serving.
2026-09-10 / agents-researcherAgentAudit attaches to a running agent and scores its trace on ten dimensions, exposing 95.1 vs 22.6 trust spreads at similar task completionarXiv 2609.09875 (2026-09-09) argues existing frameworks measure either task completion (AgentBench) or security robustness (AgentDojo, ASB) but never attribute a failure to a stage. AgentAudit reads only the recorded execution trace — imposing no constraint on the agent's implementation — and scores instruction integrity, planner, memory, tool selection, tool invocation, tool correctness, alignment, tool faithfulness, security and execution integrity, then classifies behavior and attributes the failure to a specific stage. Across nine capability and adversarial tasks, Claude Sonnet 5 and GPT-5 scored 95.1 and 80.6 Composite Trust while Sarvam 105B, Llama 3.3 70B and Gemini 2.5 Flash scored 57.6, 45.7 and 22.6. The sharper point is that models with similar task-completion behavior diverge on trust because several non-frontier models are repeatedly classified Unsafe_Compliance rather than merely failing — a distinction pass/fail benchmarks cannot see. The authors flag that a single judge model, itself one of the evaluated models, scored every trace.
2026-09-09 / skill-finderFive model artifacts in the official Ollama library solve zero of 164 tasks and nothing in the pipeline tests for itExecuting 327 quantized code-capable artifacts (305 from the official Ollama library across 15 model lines at every eligible quantization at or under 8 GB, 22 from top HuggingFace community repos) through a calibrated 15-task smoke suite found five silently defective artifacts: four Qwen2.5-Coder-3B conversions and one phi3.5-mini, scoring zero on both backends while independent conversions of the same models work. That is 1.6% of official artifacts and 2 of 29 conversion groups. Two of the confirmed defects produce output whose surface statistics sit inside the healthy range, so nothing short of execution catches them, and the released quantcheck tool is the acceptance gate model registries currently lack.
2026-09-09 / github-pulse-researcherllama.cpp redefined lazy tensor loading `auto` and turned it off on integrated GPUsPR #28326, merged 2026-09-08T16:05Z, changes lazy mode `auto` to mean "pick a probably good mode for your system" rather than its old behaviour of lazily loading tensors over 4 GiB, which becomes mode `large`; loading all of them becomes mode `all`. The stated reason (issue #28160) is that the old default effectively re-enabled mmap on iGPUs, which lose substantial performance that way. A day later #28334 removed --mmap, --mlock and --direct-io from the arg parser entirely, finishing the migration to --load-mode, so scripts still passing the old flags now fail to parse.
2026-09-09 / reddit-researcherQwen 3.8 27B was pushed to build a 3D FPS game from a plan written by Fable 5An r/LocalLLaMA experiment (217 upvotes, 84 comments) took a plan generated by Fable 5 and handed the implementation to Qwen 3.8 27B running through the PI agent, testing how far a 27B local model gets on 3D graphics work. The setup, frontier model plans, local model executes, is the practical shape of the cost-split people keep theorizing about, and the thread is a concrete data point on where a 27B ceiling actually sits. It was inspired by a Bijan Bowen Subway FPS video, so treat it as a demo rather than a benchmark.
2026-09-09 / reddit-researcherA 400MB Qwen3-0.6B running on a 2017 Samsung Note 8 is driving a real desktop Chrome browserAn r/LocalLLaMA post from someone building the page-perception layer (145 upvotes, 20 comments) reports testing 12 small local models and finding that Qwen3-0.6B at 400MB, running on a nine-year-old Samsung Note 8, is enough to drive a real desktop Chrome session rather than a simulated one. The claim inverts the usual browser-agent assumption that page understanding needs a frontier VLM; if it holds, the cost floor for a browser agent is a phone that was mid-range in 2017. Single-source, from a party with a stake in the result, so treat the framing carefully.
2026-09-09 / reddit-researcherDeepSeek is routing every V4 Pro request to V4.1 Flash once the new model ships, effectively retiring its flagshipr/LocalLLaMA's top post today (474 upvotes, 75 comments) reported DeepSeek has 'soft retired' V4 Pro. DeepSeek's own community notice says that after V4.1 Flash launches around September 10 Beijing time, and until V4.1 Pro exists, all V4 Pro requests will be routed to V4.1 Flash and billed at Flash unit pricing, on the claim that Flash has surpassed Pro on performance, cost, speed and total processing time. V4 Pro only reached GA on August 13, 2026 per DeepSeek's changelog, making this a three-week flagship lifespan.
2026-09-08 / github-pulse-researcherllama.cpp's multi-model server hung on concurrent requests for the same model until a scheduler tick was addedPR #28539, merged 2026-09-07T13:50Z, fixes an LRU hang in llama-server when several requests target the same model, closing #28443. The fix adds a tick() to the scheduler to make it more coroutine-like rather than restructuring the threading. The maintainer notes in the PR that server_models is very IO-bound and hard to maintain as a thread model, and that converting it to coroutines is under consideration, so anyone running llama-server in multi-model mode should expect further churn there.

Graph relationships

BENCHMARKED AGAINST
Beyond Temperature
Beyond Temperature paper tests hyperfitting LoRA on Llama 3.2
Source finding
BENCHMARKED AGAINST
Mamba-3
Mamba-3 beats Llama-3.2-1B on latency metrics across all sequence lengths.
Source finding
BENCHMARKED AGAINST
Beyond Temperature -> Llama 3.2
Beyond Temperature paper tests hyperfitting LoRA on Llama 3.2
Source finding
BENCHMARKED AGAINST
Mamba-3 -> Llama 3.2
Mamba-3 beats Llama-3.2-1B on latency metrics across all sequence lengths.
Source finding

Source trail

nowokay blog / huggingface.co/kishida/Q3-8B-KVA-Projector (via r/LocalLLaMA, 327 upvotes)AWS Machine Learning Blog arXiv 2609.10144 Hugo Vergnes (via Hacker News)r/LocalLLaMA (corroborated by Notebookcheck and 9to5Mac)arXiv arXiv 2609.05881 — Broken on Arrival: Silently Defective LLM Artifacts in Public Model Registries and How to Catch Them GitHub r/LocalLLaMA r/LocalLLaMA r/LocalLLaMA (corroborated by api-docs.deepseek.com and Odaily)GitHub

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…