Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
+1
Serge is a chat interface crafted with llama.cpp for running GGUF models. No API keys, entirely self-hosted!
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Online
- Self-Hosted
- Docker
