

Serge
1 like
Serge is a chat interface crafted with llama.cpp for running GGUF models. No API keys, entirely self-hosted!
Cost / License
- Free
- Open Source
Platforms
- Online
- Self-Hosted
- Docker
Features
- Nginx
Support for Docker
Tags
- fastapi
- alpaca
- tailwindcss
- sveltekit
- llamacpp
- svelte
- llama
- Python
Serge information
No comments or reviews, maybe you want to be first?
Post comment/reviewWhat is Serge?
Serge is a chat interface crafted with llama.cpp for running GGUF models. No API keys, entirely self-hosted!
- SvelteKit frontend
- Redis for storing chat history & parameters
- FastAPI + LangChain for the API, wrapping calls to llama.cpp using the python bindings


