A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.




Voelori is described as 'A local-first Windows AI ecosystem: a multi-module workspace, a persistent AI agent, and a voice assistant. Runs offline. One-time purchase, no subscription' and is an app in the ai tools & services category. There are more than 50 alternatives to Voelori for a variety of platforms, including Mac, Windows, Linux, Android and iPhone apps. The best Voelori alternative is Ollama, which is both free and Open Source. Other great apps like Voelori are Jan.ai, GPT4ALL, Ensu and Open WebUI.
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.




Install, run & control servers, bots, databases, AI apps, terminal apps, or anything on your computer with 1 click.



Open-source app offers local or cloud AI chat with major LLMs, advanced semantic search, automation, personal newsletters, document indexing, image generation, and text-to-speech. Access from web, Obsidian, Emacs, desktop, mobile, or messaging platforms.




The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.




Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.




Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

Tool for downloading AI and machine learning models from Hugging Face, Model Scope, and Civitai on Windows, featuring command line and GUI options, efficient management of large file downloads, integrity checks, and progress monitoring for users.



The Swiss Army Knife of offline AI. Chat, speak, and generate images. Privacy first, zero internet. Download an LLM and use it on your mobile device. No data ever leaves your phone.




KoboldCpp is an easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI...




Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).




ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.



