Public story · 2026-03-18 · source-backed
Mamba-3 Beats Transformers on Decode Latency at 1.5B Scale.
Story
Together AI published Mamba-3 as an ICLR 2026 paper — new SSM with complex-valued state transitions beating Mamba-2, Gated DeltaNet, and even Llama-3.2-1B on prefill+decode latency across all sequence lengths. The MIMO variant adds +1.2 points average downstream accuracy on top of the +0.6 from the base architecture. Full open-source release. Together AI
Related stories
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source / Shared topic / What happened next
Mamba-3: Inference-First SSM Beats Transformers 4%, Runs 7x Faster.
Both cover ICLR, Mamba, SSM; cite the same source (Together AI); overlapping topics (architecture, beat, complex-valued, mamba-3).
Shared entity: Gated DeltaNet / Shared topic / Earlier coverage
Qwen 3.5 Small Models: Browser-Runnable AI Validated (1,717 upvotes)
Both cover Gated DeltaNet; overlapping topics (architecture, beat, deltanet, gated); earlier Gated DeltaNet coverage from 2026-03-03.
Shared entities / What happened next
Xiaomi Just Open-Sourced a 1-Trillion Parameter Model Under MIT License. It Built a Compiler in 4 Hours.
Both cover Full, Llama; picks up the Full thread on 2026-05-01.
Shared entity: ICLR / Shared topic / What happened next
GEPA beats RL prompt tuning with 35x fewer rollouts.
Both cover ICLR; overlapping topics (average, beat); picks up the ICLR thread on 2026-06-12.
Shared entity: Together AI / Same source domain / What happened next
Together AI Ships ATLAS: Speculative Decoding That Learns YOUR Codebase at Runtime. 400% Speedup.
Both cover Together AI; reported by the same outlet (together.ai); picks up the Together AI thread on 2026-05-05.
Shared entity: Full / Shared topic / Earlier coverage
AI2 Olmo Hybrid 7B — 2x Training Efficiency via Hybrid Architecture.
Both cover Full; overlapping topics (architecture, full); earlier Full coverage from 2026-03-08.
Shared entity: Gated DeltaNet / Shared topic / Earlier coverage
OLMo Hybrid 7B: 2x Data Efficiency Proves the Transformer-Only Era May Be Ending.
Both cover Gated DeltaNet; overlapping topics (accuracy, architecture); earlier Gated DeltaNet coverage from 2026-03-07.
Qwen 3.5 Small Series Drops: Natively Multimodal, 262K Context, Apache 2.0
Both cover Gated DeltaNet; overlapping topics (architecture, beat); earlier Gated DeltaNet coverage from 2026-03-02.
Source trail
Entities
Provenance
- Canonical issue
- Ramsay Research Agent — March 18, 2026
- AI generated
- no
- Story unit
- 2026-03-18-mamba-3-beats-transformers-on-decode-latency-at-1-5b-scale
- Labels
- source-backed, canonical briefing excerpt