← The Wire

Public story · 2026-03-18 · source-backed

Mamba-3 Beats Transformers on Decode Latency at 1.5B Scale.

Confidence
source-backed
Sources
1
Redaction
passed

Story

Together AI published Mamba-3 as an ICLR 2026 paper — new SSM with complex-valued state transitions beating Mamba-2, Gated DeltaNet, and even Llama-3.2-1B on prefill+decode latency across all sequence lengths. The MIMO variant adds +1.2 points average downstream accuracy on top of the +0.6 from the base architecture. Full open-source release. Together AI

Related stories

Each link below shares sources, entities, or timing with this story.

  1. Shared entities / Same source / Shared topic / What happened next

    Mamba-3: Inference-First SSM Beats Transformers 4%, Runs 7x Faster.

    Both cover ICLR, Mamba, SSM; cite the same source (Together AI); overlapping topics (architecture, beat, complex-valued, mamba-3).

  2. Shared entity: Gated DeltaNet / Shared topic / Earlier coverage

    Qwen 3.5 Small Models: Browser-Runnable AI Validated (1,717 upvotes)

    Both cover Gated DeltaNet; overlapping topics (architecture, beat, deltanet, gated); earlier Gated DeltaNet coverage from 2026-03-03.

  3. Shared entities / What happened next

    Xiaomi Just Open-Sourced a 1-Trillion Parameter Model Under MIT License. It Built a Compiler in 4 Hours.

    Both cover Full, Llama; picks up the Full thread on 2026-05-01.

  4. Shared entity: ICLR / Shared topic / What happened next

    GEPA beats RL prompt tuning with 35x fewer rollouts.

    Both cover ICLR; overlapping topics (average, beat); picks up the ICLR thread on 2026-06-12.

  5. Shared entity: Together AI / Same source domain / What happened next

    Together AI Ships ATLAS: Speculative Decoding That Learns YOUR Codebase at Runtime. 400% Speedup.

    Both cover Together AI; reported by the same outlet (together.ai); picks up the Together AI thread on 2026-05-05.

  6. Shared entity: Full / Shared topic / Earlier coverage

    AI2 Olmo Hybrid 7B — 2x Training Efficiency via Hybrid Architecture.

    Both cover Full; overlapping topics (architecture, full); earlier Full coverage from 2026-03-08.

  7. Shared entity: Gated DeltaNet / Shared topic / Earlier coverage

    OLMo Hybrid 7B: 2x Data Efficiency Proves the Transformer-Only Era May Be Ending.

    Both cover Gated DeltaNet; overlapping topics (accuracy, architecture); earlier Gated DeltaNet coverage from 2026-03-07.

  8. Qwen 3.5 Small Series Drops: Natively Multimodal, 262K Context, Apache 2.0

    Both cover Gated DeltaNet; overlapping topics (architecture, beat); earlier Gated DeltaNet coverage from 2026-03-02.

Source trail

Entities

Provenance

AI generated
no
Story unit
2026-03-18-mamba-3-beats-transformers-on-decode-latency-at-1-5b-scale
Labels
source-backed, canonical briefing excerpt