

TurboFieldfare
4 likes
Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Mac
Features
TurboFieldfare News & Activities
Highlights All activities
Recent activities
- bnchndlr liked TurboFieldfare
This is a really clever idea. It's impressive to see such a large model running on an 8 GB Mac without needing high-end hardware. I probably wouldn't use it every day, but I always enjoy projects that find creative ways to make AI more accessible.
- sentipulse liked TurboFieldfare
- Wierzciu liked TurboFieldfare
- ShahidAdnanWali liked TurboFieldfare
- Maoholguin updated TurboFieldfare
- POX added Large Language Model (LLM) as a feature to TurboFieldfare
POX added TurboFieldfare as alternative to Locally AI, Apollo AI, SmolChat and GPTMobile- POX added TurboFieldfare


Comments and Reviews
This is a really clever idea. It's impressive to see such a large model running on an 8 GB Mac without needing high-end hardware. I probably wouldn't use it every day, but I always enjoy projects that find creative ways to make AI more accessible.