

Serge
1 like
Serge is a chat interface crafted with llama.cpp for running GGUF models. No API keys, entirely self-hosted!
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Online
- Self-Hosted
- Docker
Serge information
No comments or reviews, maybe you want to be first?
What is Serge?
Serge is a chat interface crafted with llama.cpp for running GGUF models. No API keys, entirely self-hosted!
- SvelteKit frontend
- Redis for storing chat history & parameters
- FastAPI + LangChain for the API, wrapping calls to llama.cpp using the python bindings


