Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
- Global




Apps similar to OptiQ include Ollama, which is free and open source. Other options are Jan.ai, Ensu, GPT4ALL and AnythingLLM. There's no shortage of Large Language Model (LLM) Tools like OptiQ, with more than 50 alternatives for Mac, Windows, Linux, Android and self-hosting.
Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).







LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.


Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.



Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.



A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.

Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.




Typing Mind is a commercial alternative front end for various LLM engines, using various APIs it offers a front end interface for managing chats, uploading documents, and it’s own plugins. It can use OpenAI API, Anthropic, and OpenRouter API out of the box, and you can configure...
ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.




Local AI agents on your Mac. Private, offline, free. Open models run on Apple Silicon; add ChatGPT, Claude or Gemini only when you choose.



MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.



Experience AI chat on macOS with a SwiftUI-designed client utilizing Swift, CoreML, and BERT for native performance. Enjoy privacy-focused, intuitive chats with intelligent AI responses, profile customization, and full control via editable chat history and message rewind.
