ik_llama.cpp Adds Qwen3.5 Multi-Token Prediction Support — Speculative Decoding Fork Pushes Performance

r/LocalLLaMA·medium signal

The ik_llama.cpp fork (by ikawrakow, known for superior quantization methods) merged PR #1698 adding Multi-Token Prediction support for dense Qwen 3.5 models. The MTP head uses a full transformer block to predict the next-next token, enabling speculative decoding. Community benchmarks show ~47.5% acceptance rate. FastMTP vocabulary trimming reduces draft generation from 22ms to 6ms (3.7x speedup). 65 upvotes, 34 comments on r/LocalLLaMA with active testing.