Tip: Run Qwen 3.6-35B-A3B at 79 t/s on Consumer Hardware Using --n-cpu-moe Flag

r/LocalLLaMA·medium signal

A practitioner running RTX 5070 Ti + 9800X3D achieved 79 tokens/second with Qwen 3.6-35B-A3B at 128K context by using the --n-cpu-moe flag in llama.cpp — the single most important parameter for MoE models on consumer GPUs. The flag offloads inactive expert routing to CPU while keeping active experts on GPU. Had Claude Opus 4.7 build the config, launch servers, and run benchmarks autonomously. For anyone wanting local coding agent performance, this is the configuration that matters.