A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.




Voelori is described as 'A local-first Windows AI ecosystem: a multi-module workspace, a persistent AI agent, and a voice assistant. Runs offline. One-time purchase, no subscription' and is an app in the ai tools & services category. There are more than 50 alternatives to Voelori for a variety of platforms, including Mac, Windows, Linux, Android and Self-Hosted apps. The best Voelori alternative is Ollama, which is both free and Open Source. Other great apps like Voelori are Jan.ai, GPT4ALL, Open WebUI and Ensu.
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.




Install, run & control servers, bots, databases, AI apps, terminal apps, or anything on your computer with 1 click.



Open-source app offers local or cloud AI chat with major LLMs, advanced semantic search, automation, personal newsletters, document indexing, image generation, and text-to-speech. Access from web, Obsidian, Emacs, desktop, mobile, or messaging platforms.




Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.







Tool for downloading AI and machine learning models from Hugging Face, Model Scope, and Civitai on Windows, featuring command line and GUI options, efficient management of large file downloads, integrity checks, and progress monitoring for users.



Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.



Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).




Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.




ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.




The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.



