llama.cpp b10069: Adreno OpenCL broadcast support
llama.cpp build b10069 adds OpenCL broadcast support for Adreno MUL_MAT operations and fixes view offset handling for Adreno Q8_0 MUL_MAT in llama-server multi-stream mode.
llama.cpp b10067 fixes DeepSeek-V4 quantization crash in llama-quantize
llama.cpp build b10067 patches a bug where the DeepSeek-V4 routing table tensor was being incorrectly quantized, causing a type conversion failure that blocked anyone using llama-quantize on the model.
llama.cpp CPU offload reportedly tripled DeepSeek V4 Flash speed on a 4060 Ti
A Reddit report claims the 98GB DeepSeek-V4-Flash quant jumped from 2 to 7 t/s on a single 4060 Ti plus CPU, with no hardware changes between two llama.cpp builds.
llama.cpp b9993 adds Hunyuan 3 support with MTP speculative decoding
Build b9993 merges PR #25395, adding native hy_v3 architecture support so Tencent's Hunyuan 3 MoE runs locally in llama.cpp, with MTP speculative decoding included.
Spiritbuun's VBR KV cache squeezes more context into 12GB
A llama.cpp fork from spiritbuun adds Variable Bit Rate KV cache quantization, dynamically degrading cache precision only when VRAM pressure demands it.
llama.cpp b9963 fixes DeepSeek-OCR v1 multi-tile tiling
Build b9963 lands proper multi-tile support for DeepSeek-OCR v1 with dynamic resolution, and unifies the image preprocessor for both v1 and v2. Multi-column documents now handled correctly.
llama.cpp adds an initial ExecuTorch backend for edge and on-device deployment
Build b9951 of llama.cpp drops an initial ExecuTorch backend, planting a flag for GGUF-format models on PyTorch's on-device inference stack and the edge hardware it targets.