Multi-Token Prediction on AMD W7900: 1.85× speedup with llama-server Vulkan (Qwen3.6-35B benchmark)
We benchmark Multi-Token Prediction in llama-server (llama.cpp, Vulkan) on AMD PRO W7900. Real results: 49.7 → 91.8 tok/s, up to 2× on…
Tag