bitnet.cpp

Official inference framework for 1-bit LLMs, by Microsoft.

Visit website(opens in a new tab)