Benchmark lab for local models: real 27B-35B results on one 48 GB GPU
A practical benchmark lab for local models on AMD PRO W7900 48 GB. Real tok/s, TTFT, disk size, VRAM after loading and…
Tag
Tag: benchmark
Multi-Token Prediction on AMD W7900: 1.85× speedup with llama-server Vulkan (Qwen3.6-35B benchmark)
We benchmark Multi-Token Prediction in llama-server (llama.cpp, Vulkan) on AMD PRO W7900. Real results: 49.7 → 91.8 tok/s, up to 2× on…