Llama.go
Open-source port of llama.cpp to pure Go that runs LLaMA and GPT-style model inference on an ordinary PC, with no powerful GPU cluster needed.
Open sourceCoding & Development
Visit website(opens in a new tab)
Open-source port of llama.cpp to pure Go that runs LLaMA and GPT-style model inference on an ordinary PC, with no powerful GPU cluster needed.