A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.




OptiQ is described as 'MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud' and is a large language model (llm) tool in the ai tools & services category. There are more than 50 alternatives to OptiQ for a variety of platforms, including Mac, Windows, Linux, Android and Web-based apps. The best OptiQ alternative is Ollama, which is both free and Open Source. Other great apps like OptiQ are Jan.ai, GPT4ALL, Open WebUI and Ensu.
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.




Install, run & control servers, bots, databases, AI apps, terminal apps, or anything on your computer with 1 click.



Open-source app offers local or cloud AI chat with major LLMs, advanced semantic search, automation, personal newsletters, document indexing, image generation, and text-to-speech. Access from web, Obsidian, Emacs, desktop, mobile, or messaging platforms.




Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.




The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.







Tool for downloading AI and machine learning models from Hugging Face, Model Scope, and Civitai on Windows, featuring command line and GUI options, efficient management of large file downloads, integrity checks, and progress monitoring for users.



Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.



Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).




Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.




A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
