AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
KoboldCpp Alternatives
KoboldCpp is described as 'Easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI' and is a large language model (llm) tool in the ai tools & services category. There are more than 10 alternatives to KoboldCpp for a variety of platforms, including Mac, Windows, Linux, Android and Self-Hosted apps. The best KoboldCpp alternative is GPT4ALL, which is both free and Open Source. Other great apps like KoboldCpp are LM Studio, Pinokio, Onit AI and local.ai.
Alternatives list
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Python
- Mac
- Linux
- Self-Hosted
- Kubernetes
- OpenShift


+1
- 51 Osaurus alternatives
AI edge infrastructure for macOS. Run local or cloud models, share tools across apps via MCP, and power AI workflows with a native, always-on runtime.

ArgalAI is an offline AI chat app that allows you to chat with the latest AI models to get things done or have a bit of fun. Best of all, there are no monthly fees, and none of your chats ever leave your device.


+2
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Rust
- Mac
- Linux
- Windows
- BSD
- Docker
- Node.JS
Gai is a beginner-friendly AI toolkit with no ads, no registration, and no other permissions required, except for Internet.
Cost / License
- Free
- Proprietary
Application type
Platforms
- Windows
- Mac
- Linux
- Flathub
- Flatpak
- iPhone
- iPad
- Android
- Android Tablet



- 27 llama.cpp alternatives
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Cost / License
- Free
- Open Source (MIT)
Application types
Platforms
- Windows
- Mac
- Linux
- Docker
- Homebrew
- Nix Package Manager
- MacPorts
- Self-Hosted


+9
XX.AI offers a simple and cost-effective solution for unlimited access to GPT-4, Claude 3, and DALL-E 3. With essential shortcuts like Shift + A for instant activation, you can harness the power of AI in any writing or content creation task.
Cost / License
- Freemium
- Proprietary
Platforms
- Mac
- Windows



HugstonOne Enterprise Edition — Awesome AI App with Code editor and Live Preview Create games, dashboards, maps, tables, charts, webpages, data analysis, converters etc in seconds.
Cost / License
- Free
- Proprietary
Application types
Platforms
- Windows
- Linux


+6



Cloudflare Workers AI provides a serverless platform to execute AI models utilizing GPUs in its network, eliminating infrastructure needs. Access over 50 open-source models, use AI Gateway for app control, and deploy globally with tools like Vectorize, R2, and D1.
Cost / License
- Freemium
- Proprietary
Platforms
- Online
- Software as a Service (SaaS)


QVAC converts local AI into a high-quality experience that sits in your pocket. All the value you’re used to seeing in other AI assistants, minus the lack of privacy.
Cost / License
- Free
- Proprietary
Platforms
- Mac
- Linux
- Windows
- Flathub
- Flatpak


+1
























