A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
Cost / License
- Free
- Open Source (AGPL-3.0)
Application typeApplication types
Platforms
- Linux
- Windows
- Mac
RWKV Runner Alternatives
Apps similar to RWKV Runner include Ollama, which is free and open source. Other options are Jan.ai, GPT4ALL, AnythingLLM and LM Studio. You can choose from more than 10 Large Language Model (LLM) Tools like RWKV Runner for Windows, Linux, Mac, self-hosting and Android.
Alternatives list
MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.
Cost / License
- Free
- Open Source (Apache-2.0)
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- Online
- Android
- iPhone
- iPad
- Python
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
Cost / License
- Free Personal
- Open Source (MIT)
Application typeApplication types
Platforms
- Windows
- Online
- Self-Hosted
24 AI Playground alternativesThis application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...
Cost / License
- Free
- Open Source (MIT)
Application typeApplication types
Platforms
- Windows
United States
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Windows
- Linux
- Docker
- Snapcraft
- iPhone
- iPad
- Self-Hosted
- Python
- United States
+1
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Windows
- Mac
- Linux
- Rust
Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Windows
- United States
+1
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Python
- Mac
- Linux
- Self-Hosted
- Kubernetes
- OpenShift
Australia
+1
70 Operit AI alternatives📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱
Cost / License
- Free
- Open Source (LGPL-3.0)
Platforms
- Android
China
A local-first Windows AI ecosystem: a multi-module workspace, a persistent AI agent, and a voice assistant. Runs offline. One-time purchase, no subscription.
Cost / License
- Paid
- Proprietary
Platforms
- Windows
- United States
