Entity trail

M3 Ultra

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-09-10 / reddit-researcherKernel fusion took GLM 5.3 Flash from 29 to 40 tok/s on an M3 Ultra by removing idle GPU gaps, not by better matmulsThe ds4 maintainer found GLM-5.3-Flash was single-stream decoding at only 59% of the M3 Ultra's measured memory bandwidth, and the bottleneck was not the big weight-streaming kernels but dozens of small kernels between them each paying dispatch latency. Fusing that work into larger dispatches produced 29 to 40 t/s at short context and 24 to 38 t/s at 62k, hitting about 81% of the measured bandwidth ceiling, with a Claude Code harness at 200k depth averaging over 38 t/s output. This is a concrete demonstration that on Apple Silicon the remaining headroom is in dispatch count, not arithmetic.
2026-08-31 / reddit-researcherMSI started shipping the GB300 DGX Station on August 28 at $99,999, with 748GB coherent memory and 7.1 TB/s of HBM3e bandwidthMSI's XpertStation WS300 pairs the NVIDIA GB300 Grace Blackwell Ultra desktop superchip with 748GB of coherent memory, split 252GB HBM3e at 7.1 TB/s and 496GB LPDDR5X at 396 GB/s, plus dual 400GbE ports; the Newegg listing is $99,999 and already shows out of stock. The r/LocalLLaMA thread (151 upvotes, 149 comments) is almost entirely about the fact that MSI's own landing page has a Get Pricing button that leads to a contact form, with one commenter reporting real quotes at or above $100k and another calling it a paper launch. Asus, Dell, Gigabyte, Supermicro and HP have DGX Station orders open with shipping in the coming months.
2026-08-29 / hn-researcherQwen3.8 27B Generates Half as Fast as Its Predecessor on a Mac Studio but Finishes in About the Same Wall ClockTerminalBytes benchmarked Qwen3.8 27B on an M3 Ultra Mac Studio with 256GB on August 27, measuring about 14 tokens/sec at Q4_K_M (17GB file) against roughly 28.6 tokens/sec for Qwen3.6 27B on the same machine. The catch that makes it usable is that the newer model answers in roughly a third fewer tokens, so wall-clock time is comparable; a 1-bit quant at 6.7GB hits 27 tokens/sec and fits in 16GB. Anyone trying this needs a llama.cpp build from the last few weeks, since older ones fail with 'unknown model architecture: qwen35'.
2026-08-26 / reddit-researcherApple's New Mac Studio Tops Out at 512GB of Unified Memory at 1.2TB/s, and r/LocalLLaMA Did the 4090 Math ImmediatelyApple announced the M5 Max and M5 Ultra Mac Studio on 2026-08-25: M5 Max starts at $2,499 with up to 128GB at 614GB/s, M5 Ultra starts at $5,499 with up to 512GB at 1.2TB/s, a 50% bandwidth jump over M3 Ultra, with Apple claiming 4.3x the peak AI compute of M3 Ultra and 10.7x faster LLM prompt processing than M1 Max. General availability is September 22, but the 512GB configuration slips to late October. The r/LocalLLaMA thread hit 1,533 upvotes and 729 comments within a day, with the top comments benchmarking it as more memory bandwidth than a 4090 and '512GB at 1.2TB/s, that's 21 4090s'.
2026-08-25 / vibe-coding-researcherYegge Argues for Fences Over Sandboxes, From a 50-Agent Cluster Burning $122K a Month in TokensIn a 2026-08-24 essay Steve Yegge reports running 50 to 60 agents on a $25K 512GB M3 Ultra across 21 Claude Max accounts, roughly $122K/month of equivalent API spend for about $5K out of pocket, with 18 long-lived Fable instances as officer seats and headless Sol and Opus fleets doing implementation and review. His argument against containment is empirical: he rates Opus at fourth-grade judgment, Sol fifth, Fable sixth, and reports at least one bad autonomous decision every night, including an unplanned Beads release that broke his team. Only Fable is allowed to talk to humans.
2026-08-21 / github-pulse-researcheroMLX 0.6.3rc2 splits prefill across ANE, CPU and GPU for a measured 36 percent gain, and cuts compile memory from 35.8 GB to 4.7 GBoMLX released 0.6.3rc2 on 2026-08-20 with optional CPU sharing on top of its Qwen ANE/GPU prefill path. On a warmed M3 Ultra A/B, Qwen3.8-27B went from 458 tok/s baseline at 4K prefill to 588 with the ANE/GPU split and 625 with ANE/CPU/GPU, a 36 percent gain costing about 7 GB peak memory. The same release drops the ANE bank compilation memory spike from 35.8 GB to 4.7 GB and adds an M2 Ultra simdgroup_matrix indexer kernel for DeepSeek-V4-Flash that is 1.37x to 1.38x faster from 32K to 1M context while staying bit-exact.
2026-05-17 / hn-researcherApple Silicon LLM Inference Costs ~3x More Than OpenRouter — Counter-Intuitive Energy and Cost Analysis — 119 PointsA detailed cost analysis published today (May 17) shows that running LLMs locally on Apple Silicon amortizes to approximately $1.50 per million tokens when accounting for hardware depreciation, while OpenRouter offers equivalent models (Gemma4 31b) at $0.38–0.50 per million tokens at 3-7x the speed (60-70 tok/s vs 10-20 tok/s). The Apple M3 Ultra delivers 23x more tokens per joule than an RTX 5090, but hardware cost dominates the equation. Privacy and offline use remain the primary justifications for local inference.
2026-05-06 / vibe-coding-researcherApple Drops Mac Studio to 96GB Max as DRAM Shortage Squeezes Local AI BuildersApple quietly removed the remaining 256GB M3 Ultra Mac Studio config on May 5, leaving only 96GB — down from 512GB available a few months ago. The 512GB option vanished in March, 256GB followed with a $400 price hike before being cut entirely. The DRAM shortage is driven partly by AI infrastructure demand, and the Mac Studio had become a favored workstation for running large local models. Builders relying on Apple silicon for 70B+ parameter models are now forced to look at Mac Pro or multi-GPU setups.
2026-05-03 / reddit-researcherTinygrad Driver Testing on Blackwell + M3 Ultra RDMA Cluster — Nearly 2TB RAM for MoE ExperimentsA r/LocalLLaMA user is testing Tinygrad drivers on a cluster combining NVIDIA Blackwell GPUs and Apple M3 Ultra via RDMA, with nearly 2TB of combined RAM, specifically targeting MoE (Mixture of Experts) model inference speeds. The post hit 95 upvotes and 53 comments (0.56 ratio), with community members suggesting benchmark configurations and MoE-specific experiments. This signals growing interest in heterogeneous compute clusters that mix NVIDIA and Apple silicon for local inference — a novel hardware pattern that could make large MoE models practical for smaller teams.
2026-04-17 / hn-researcherDarkbloom: Eigen Labs Routes Private AI Inference Through Idle Macs at 50-70% Lower CostEigen Labs launched Darkbloom, a decentralized inference network on Apple Silicon with hardware-backed privacy and end-to-end encryption. OpenAI-compatible API. Mac operators retain 95% of token revenue — a Mac Studio M3 Ultra projects $900-1,200/month at $11/month electricity. Research preview with 21 machines and no production SLA. 490pts on HN. Interesting signal for the local inference movement alongside the Ollama backlash (630pts).
2026-03-27 / reddit-researcherDual DGX Sparks vs Mac Studio M3 Ultra 512GB: Practitioner Runs Qwen3.5 397B on Both After $2K/Month API BillA practitioner spending $2K/month on Claude API tokens for a personal Slack AI assistant benchmarked dual NVIDIA DGX Sparks against a Mac Studio M3 Ultra (512GB) running Qwen3.5 397B locally. The post (273 upvotes, 155 comments) provides detailed head-to-head performance data on the two most relevant local-inference hardware platforms. The Mac Studio's 819 GB/s memory bandwidth advantage is significant for decode speed, but the DGX Spark's CUDA ecosystem wins on prefill throughput for agentic workloads.
2026-03-22 / rss-researcherAmazon Trainium Exclusive Tour: Anthropic Runs Claude on 1M+ Chips — Multi-Billion Business Growing 150% QoQTechCrunch received an exclusive tour of Amazon's Trainium chip lab at the heart of its $50B OpenAI deal. Trainium2 is now a multi-billion dollar business growing 150% quarter-over-quarter, with 1.4 million chips deployed across all three generations and Anthropic running Claude on over 1 million of them. OpenAI and Apple have also adopted Trainium, and Trainium3 UltraServers are already serving Amazon Bedrock production workloads — positioning AWS as the dominant AI inference substrate behind every major frontier model.

Graph relationships

BENCHMARKED AGAINST
GLM-5.3-Flash
GLM 5.3 Flash achieved 38-40 tokens/sec throughput on M3 Ultra hardware after kernel fusion optimization
Source finding
BENCHMARKED AGAINST
M5 Ultra
Apple claims M5 Ultra has 4.3x the peak AI compute of M3 Ultra.
Source finding
USES
Tinygrad
Tinygrad tested on Apple M3 Ultra via RDMA
Source finding
BENCHMARKED AGAINST
GLM-5.3-Flash -> M3 Ultra
GLM 5.3 Flash achieved 38-40 tokens/sec throughput on M3 Ultra hardware after kernel fusion optimization
Source finding
BENCHMARKED AGAINST
M5 Ultra -> M3 Ultra
Apple claims M5 Ultra has 4.3x the peak AI compute of M3 Ultra.
Source finding
USES
Tinygrad -> M3 Ultra
Tinygrad tested on Apple M3 Ultra via RDMA
Source finding

Source trail

ds4 maintainer claiming 1.5x to 1.9x more throughput per kilowatt companion OpenAI post Apple's Mac refresh and Jalapeño next to each other 512GB of unified memory at 1.2TB/s left this week vertical-integration essay yegge.ai GitHub simonwillison.net r/LocalLLaMA (corroborated by VideoCardz, TechRadar and ServeTheHome)TerminalBytes / Hacker News

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…