Felafax

Open-source repo and infrastructure for fine-tuning and serving LLMs on non-NVIDIA chips, including a Llama 3.1 port to JAX that runs on Google TPUs.

Visit website(opens in a new tab)