llama.cpp CPU offload reportedly tripled DeepSeek V4 Flash speed on a 4060 Ti
A Reddit report claims the 98GB DeepSeek-V4-Flash quant jumped from 2 to 7 t/s on a single 4060 Ti plus CPU, with no hardware changes between two llama.cpp builds.
A Reddit report claims the 98GB DeepSeek-V4-Flash quant jumped from 2 to 7 t/s on a single 4060 Ti plus CPU, with no hardware changes between two llama.cpp builds.