Text generation web UI
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
Features
- Privacy focused
- No registration required
- Dark Mode
- No Tracking
- Extensible by Plugins/Extensions
- Ad-free
- AI Chatbot
- AI Writing
Text generation web UI News & Activities
Highlights • All activities
Recent activities
doricindie added Text generation web UI as alternative to Reflection 70B
jdakfkj333 added Text generation web UI as alternative to Jellybox- lightgazelle liked Text generation web UI
POX added Text generation web UI as alternative to Cody AI
Maoholguin added Text generation web UI as alternative to Stable Assistant
ArnoldBurg77 added Text generation web UI as alternative to TwinTwit: Ai Browser
POX added Text generation web UI as alternative to Apple Intelligence
pastel_p1xel_punK added Text generation web UI as alternative to Chatwith
Breat added Text generation web UI as alternative to Ashampoo AI Assistant
AbstractGeo added Text generation web UI as alternative to Open WebUI
Text generation web UI information
Developed by
oobaboogaLicensing
Open Source (AGPL-3.0) and Free product.Written in
Alternatives
34 alternatives listedSupported Languages
- English
AlternativeTo Category
AI Tools & ServicesGitHub repository
- 39,545 Stars
- 5,199 Forks
- 252 Open Issues
- Updated Sep 16, 2024
What is Text generation web UI?
A Gradio web UI for Large Language Models. Its goal is to become the AUTOMATIC1111/stable-diffusion-webui of text generation.
Features
- 3 interface modes: default (two columns), notebook, and chat
- Multiple model backends: transformers, llama.cpp, ExLlama, ExLlamaV2, AutoGPTQ, GPTQ-for-LLaMa, CTransformers
- Dropdown menu for quickly switching between different models
- LoRA: load and unload LoRAs on the fly, train a new LoRA using QLoRA
- Precise instruction templates for chat mode, including Llama-2-chat, Alpaca, Vicuna, WizardLM, StableLM, and many others
- 4-bit, 8-bit, and CPU inference through the transformers library
- Use llama.cpp models with transformers samplers (llamacpp_HF loader)
- Multimodal pipelines, including LLaVA and MiniGPT-4
- Extensions framework
- Custom chat characters
- Very efficient text streaming
- Markdown output with LaTeX rendering, to use for instance with GALACTICA
- API, including endpoints for websocket streaming (see the examples)
Said about Text generation web UI as an alternative
Gadric Gadwin
I like that my conversations aren't uploaded to be used to finetune someone else's model. I also like that I have full control over the software.
Positive comment •Feb 17, 2024
• as an alternative to
Comments and Reviews
Probably the best privacy, offline gui there is currently. Allows you to not only chat and embed, but also do lora training.
A little bit more difficult to set up than GPT4ALL, but anyone could do it by following the directions.