Custom Swift and Metal runtime enabling 26B instruction-tuned model inference in around 2 GB RAM by streaming weights from SSD, optimized for Apple Silicon Macs.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Mac
United Kingdom




































































