A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.

Comments about Text generation web UI as an Alternative to OfflineLLM


- Text generation web UI is Free and Open Source
- Text generation web UI is Privacy focused


























































Text-generation-web-ui has the most features, and is very lightweight. Probably the best offline LLM tool at the moment.