NInfer: 542 tok/s on Qwen3.6-35B-A3B, single request, one RTX 5090
A solo dev open-sourced NInfer, a from-scratch C++/CUDA engine that sustains 542 tok/s on Qwen3.6-35B-A3B over a full 65K-token decode, single request, on one RTX 5090.
Qwen3.6 27B eats your context before the session warms up
Running Qwen3.6 27B with Opencode? The model's appetite for context tokens can gut your usable window fast. Here's what's happening and how to push back.
Running three Qwen3.5 122B sessions on one Mac Studio with an on-disk KV cache
A Reddit user reportedly ran three concurrent Qwen3.5 122B sessions on a single Mac Studio, serving over 93% of prompt tokens from an on-disk KV cache instead of recomputing on GPU.
The Bench: Qwen3 14B vs Claude Fable 5 vs GPT-5.6 Sol
Three identical frontier-battery runs separated a useful local 14B model from two subscription agents, then revealed that the test needs a higher ceiling.
Unsloth NVFP4 quants for Qwen3.6 claim faster throughput than NVIDIA's own builds
Unsloth published NVFP4 quantized checkpoints for Qwen3.6 27B and 35B-A3B that reportedly beat NVIDIA's reference quants on throughput, with FP8 KV cache support for longer contexts.