Lit-LLaMA

Apache 2.0 open-source implementation of the LLaMA language model built on nanoGPT, with quantization, LoRA fine-tuning and pre-training support.

Visit website(opens in a new tab)