RWKV Runner

This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means that every ChatGPT client is an RWKV client.

Features

• RWKV model management and one-click startup.
• Front-end and back-end separation, if you don't want to use the client, also allows for separately deploying the front-end service, or the back-end inference service, or the back-end inference service with a WebUI. Simple Deploy Example | Server Deploy Examples
• Compatible with the OpenAI API, making every ChatGPT client an RWKV client. After starting the model, open http://127.0.0.1:8000/docs to view more details.
• Automatic dependency installation, requiring only a lightweight executable program.
• Pre-set multi-level VRAM configs, works well on almost all computers. In Configs page, switch Strategy to WebGPU, it can also run on AMD, Intel, and other graphics cards.
• User-friendly chat, completion, and composition interaction interface included. Also supports chat presets, attachment uploads, MIDI hardware input, and track editing. Preview | MIDI Hardware Input
• Built-in WebUI option, one-click start of Web service, sharing your hardware resources.
• Easy-to-understand and operate parameter configuration, along with various operation guidance prompts.
• Built-in model conversion tool.
• Built-in download management and remote model inspection.
• Built-in one-click LoRA Finetune. (Windows Only)
• Can also be used as an OpenAI ChatGPT, GPT-Playground, Ollama and more clients. (Fill in the API URL and API Key in Settings page)
• Multilingual localization.
• Theme switching.
• Automatic updates.