Reddit
Three Days of Independent Benchmarking on the DFlash 2 llama.cpp PR: 2.26x on Real Coding Prompts, and Two Documented Flags That Do Nothing
Inco AI shipped DFlash 2 on 2026-08-18 with a Qwen3.8-27B drafter and llama.cpp PR #27342. A practitioner built the PR on an RTX PRO 6000 and measured 2.26x on 100 LiveCodeBench problems (67.97 to 153.91 tok/s, inter-token latency 14.27 to 6.02 ms) for +2.7 GB VRAM, and 4.68x on an 18-turn coding session with one n-gram lookup table, though adding the second table dropped it to 3.77x, reversing the DFlash 1 result. Two specific corrections to the docs: --spec-draft-n-max 7 is past the peak and 5 gives roughly 11% more on 8K prompts, and --spec-draft-p-min is never read on the DFlash 2 path in common/speculative.cpp.
Source
↳ Follow the thread