Phone runs an 80GB model at 3.5 tokens a second

Someone ran Qwen3.8-Flash-Next, an 80GB model, on a mid-range Android phone with just 12GB of RAM. The video post shows it generating text at 3.5 tokens a second, slow enough to watch each word land but fast enough to prove the thing runs at all.

The top comment flags the real cost: the CPU reached 80C running this. That's not a number you build a product around. It's a number you stop a demo at before something throttles or degrades.

The trick is the same one that makes Flash-Next usable on constrained desktops, sparse mixture-of-experts routing plus offloading. The phone only has to hold and compute a fraction of those 80GB at any moment. The post adds aggressive quantization on the dense part and unspecified extra optimizations on top, though it doesn't say what those are.

A 12GB phone holding an 80GB model at all means the routing and offload math scale down further than a lot of people assumed. Whether it scales down to something you'd run during an actual phone call is a separate question, and this demo doesn't answer it. Nobody's shipping a chat app on this setup at 80C.