Mini-AGI

An open-source continual-learning model trained from scratch on an 8GB VRAM laptop with a batch-1 data stream, using a mixture-of-experts design where experts are added and pruned during training.