Apps similar to Lemonade Server include Ollama, which is free and open source. Other options are AnythingLLM, llama.cpp, MLC LLM and MNN Chat. You can choose from more than 10 Large Language Model (LLM) Tools like Lemonade Server for Windows, Mac, Linux, Android and iPhone.
Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.
United States
Open-source privacy-focused chatbot platform allowing unlimited document uploads, multi-user and single-user modes, AI-powered chat with documents, vector database and LLM compatibility, customizable interface, message history, secure desktop deployment, and full user controls.
United States
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Bulgaria
EU
MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.
China
Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.
China
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.
South Korea
Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
United States
United States
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...
United States
