Colibrì
A pure C inference engine that runs huge mixture-of-experts models such as GLM 5.2 on ordinary hardware by streaming experts from disk.
Open sourceCoding & Development
Visit website(opens in a new tab)
A pure C inference engine that runs huge mixture-of-experts models such as GLM 5.2 on ordinary hardware by streaming experts from disk.