Colibrì runs GLM-5.2 (744B MoE) on 25GB of RAM by streaming experts from NVMe
Colibrì is a pure-C, zero-dependency inference engine that runs GLM-5.2, a 744B MoE model, on a consumer machine with 25GB of RAM, by keeping dense weights in RAM and streaming routed experts from disk.