Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Windows
- Linux
- Docker
- Snapcraft
- iPhone
- iPad
- Self-Hosted
- Python
United States




Apps similar to llama.cpp include ChatGPT, which has a free version. Other options are Ollama, Jan.ai, GPT4ALL and AnythingLLM. Large Language Model (LLM) Tools like llama.cpp are a crowded field, with more than 25 alternatives for Windows, Mac, Linux, Android and iPhone.
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.







This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...




A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.




An honest AI assistant that grounds answers in real knowledge and live search — no hallucinations, no API key required. Works offline. Open source.






📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱



Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

A decentralized AI inference network where anyone can use cloud-sized models with local-grade privacy, or contribute hardware and get paid to power it.



oxproxion is a versatile and user-centric Android chat application designed to interact with various Large Language Models (LLMs). It provides a seamless interface for managing conversations, customizing bot personas, and saving chat histories.



An offline AI assistant that runs entirely from a USB drive on Windows and macOS, with no internet connection, account, or subscription.




HanFlow AI Bot takes work in one conversation: writing, images, PDF, Word, Excel and PPT files, calendar events, email drafts and code. Give it a bigger task and it works through each step, reporting back along the way.



