Fetching from the wire…
Public story · 2026-03-14 · source-backed
IndexCache identifies that DeepSeek Sparse Attention reduces core attention to O(Lk) but its lightning indexer retains O(L²) complexity. By exploiting high cross-layer index stability to reuse token selection indices, IndexCache delivers significant wall-clock throughput improvements for long-context inference without accuracy loss. Drop-in optimization for any production system using DeepSeek-style sparse attention.
Each link below shares sources, entities, or timing with this story.
DeepSelect is the TopK kernel behind the indexer in DeepSeek Sparse Attention, and DeepSeek says it runs 2-20x faster than torch.topk. DeepJIT is a header-only C++20 runtime that compiles kernels at runtime, with one interface for both NVIDIA CUDA and Huawei Ascend. deepseek-r...
DeepSeek released V4 on April 24 and the numbers demand attention. V4-Pro is 1.6 trillion parameters total with 49 billion active, MIT-licensed, native 1M-token context. It scores 80.6% on SWE-bench Verified, putting it within 0.2 points of Claude Opus 4.6. On Terminal-Bench 2...
DeepSeek released V4 Preview on April 24 with two open-weight variants: V4-Pro (1.6T total parameters, 49B activated via MoE) and V4-Flash (284B parameters, 13B activated). Both support 1M-token context windows. Both are Apache 2.0 licensed. Both are live right now on Hugging...
Netlify published an AXIS-framework evaluation on August 14 that I've been thinking about all day. Same task, 11 models, three runs each, scored on functional correctness rather than aesthetics. The task was deliberately boring: a static one-page coffee shop site with hours, a...
GLM-5.1 from Zhipu AI scored 58.4% on SWE-bench Pro. GPT-5.4 scored 57.7%. Claude Opus 4.6 scored 57.3%. That's the first time an open-weight model has ever topped a major coding benchmark against the best proprietary models. The specs matter. GLM-5.1 is a 754B-parameter mixtu...
arXiv 2609.19244 is the first end-to-end study of agentic web search across ChatGPT, Claude, Grok and DeepSeek, pairing real user interactions with controlled API experiments on the same models. Invocation rates varied substantially and more frequent searching did not yield be...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.