Apps similar to vllm-playground include Ollama, which is free and open source. Other options are Jan.ai, GPT4ALL, AnythingLLM and LM Studio. You can choose from more than 10 Large Language Model (LLM) Tools like vllm-playground for Windows, Linux, Mac, self-hosting and Android.
This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...
China
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
Open-source AI platform for running LLMs entirely on your own infrastructure, with an OpenAI-compatible API, management dashboard, and zero data egress.
Austria
EU
