llama.cpp

Inference of Meta's LLaMA model (and others) in pure C/C++.