← The Wire

Infra2026-06-28 · source-backed

DGX Spark crushes Strix Halo on prompt processing (1,723 vs 339 tok/s) but token generation is nearly even.

Confidence
source-backed
Sources
1
Redaction
passed

Story

June local-inference benchmarks across the 128GB class put NVIDIA's DGX Spark ($4k), AMD's Strix Halo / Ryzen AI Max+ 395 ($2 to 3k), and the M5 Max 128GB (~$5k) head to head (Hardware Corner). Prompt processing favors CUDA hard. But token generation lands at a surprisingly close 34 to 38 tok/s on 120B models. Strix Halo's load-bearing number is ~180 GB/s real usable bandwidth, and the community runtime is Vulkan via llama.cpp, not ROCm. Translation: prompt-heavy agentic loops want a CUDA box, but chat-style generation on the cheaper AMD option is genuinely competitive. Buy for your actual workload shape, not the headline number.


Related stories

Each link below shares sources, entities, or timing with this story.

  1. Shared entities / Earlier coverage / Downstream implication

    llama.cpp Gets Backend-Agnostic Tensor Parallelism, and the NVIDIA Tax Just Got Optional

    Both cover AMD, CUDA, NVIDIA; earlier AMD coverage from 2026-04-10; traces where this leads (what it means).

  2. Shared entities / Shared topic / Earlier coverage

    Nvidia's Blackwell Ultra Just Made Self-Hosted Inference a Real Option: 2.49M Tokens/Sec, 30 Cents Per Million

    Both cover DGX Spark, NVIDIA; overlapping topics (benchmark, number, token); earlier DGX Spark coverage from 2026-04-03.

  3. Meta's 4-Generation Custom Silicon Roadmap.

    Both cover AMD, NVIDIA; overlapping topics (bandwidth, generation); earlier AMD coverage from 2026-03-12.

  4. Shared entity: CUDA / Shared topic / Earlier coverage / Tension

    LLM-generated GPU kernels pass weak benchmarks and ship real bugs.

    Both cover CUDA; overlapping topics (benchmark, class, cuda); earlier CUDA coverage from 2026-06-20.

  5. Shared entities / Earlier coverage / Tension

    Zyphra's ZAYA1-8B was trained from scratch on AMD Instinct, not NVIDIA.

    Both cover AMD, NVIDIA; earlier AMD coverage from 2026-06-12; pushes against this story (against).

  6. OpenHands hits 70K+ stars and an $18.8M Series A, with contributors from AMD, Apple, Google, Amazon, Netflix, and NVIDIA.

    Both cover AMD, NVIDIA; earlier AMD coverage from 2026-06-10; pushes against this story (against).

  7. Shared entity: AMD / Shared topic / Earlier coverage / Downstream implication

    AMD: Agentic AI Shifts Data Center CPU/GPU Ratio Toward 1:1.

    Both cover AMD; overlapping topics (agentic, halo); earlier AMD coverage from 2026-05-10.

  8. Shared entity: NVIDIA / Shared topic / Earlier coverage / Tension

    Kimi K2.6 Beats GPT-5.4 on SWE-Bench Pro. It's Open-Weight. It Costs 88% Less.

    Both cover NVIDIA; overlapping topics (agentic, benchmark); earlier NVIDIA coverage from 2026-05-05.

Source trail

Entities

Provenance

AI generated
no
Story unit
2026-06-28-dgx-spark-crushes-strix-halo-on-prompt-processing-1-723-vs-339-tok-s-but-token-generation-is-nea
Labels
source-backed, canonical briefing excerpt