Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-02-22 · source-backed
Largest open-source sparse MoE model: 400B parameters, 13B active per token, trained on 17 trillion tokens. Novel SMEBU for load balancing. Zero loss spikes with Muon optimizer across 17T tokens — a remarkable training stability achievement. arXiv | Arcee Blog
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source / Shared topic / What happened next
Both cover Arcee Trinity Large, Largest, Sparse MoE; cite the same source (arXiv, Arcee Blog); overlapping topics (model, sparse).
Shared entities / Same source
Both cover Arcee Blog, Arcee Trinity Large; cite the same source (arXiv, Arcee Blog).
Shared entity: MoE / Shared topic / What happened next / Tension
Both cover MoE; overlapping topics (active, model, parameter); picks up the MoE thread on 2026-04-20.
Shared entity: MoE / Shared topic / What happened next
Both cover MoE; overlapping topics (active, model, parameter, token); picks up the MoE thread on 2026-04-26.
Shared entity: MoE / Same source domain / Shared topic / What happened next
Both cover MoE; reported by the same outlet (arxiv.org); overlapping topics (active, model).
Shared entity: Muon / Shared topic / What happened next
Both cover Muon; overlapping topics (model, muon, optimizer, token); picks up the Muon thread on 2026-03-04.
Shared entity: Muon / Same source domain / What happened next / Downstream implication
Both cover Muon; reported by the same outlet (arxiv.org); picks up the Muon thread on 2026-06-23.
Shared entity: MoE / Shared topic / What happened next / Tension
Both cover MoE; overlapping topics (active, model); picks up the MoE thread on 2026-06-12.