Apps similar to MLC LLM include Lumo by Proton, which is open source with a free version. Other options are ChatGPT, Ollama, Claude and Google Gemini. There's no shortage of Large Language Model (LLM) Tools like MLC LLM, with more than 50 alternatives for Mac, Windows, iPhone, Linux and Android.
Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!
Germany
EU
LlamaGPT is a chatbot that provides a ChatGPT-like experience, with no data leaving your device.
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
Empowering LLM researchers and hobbyists with seamless control over self-hosted models. Connect remotely, customize prompts, manage chats, and fine-tune configurations. All in one intuitive app.
Türkiye
Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
NanoGPT is a platform that gives you access to many AI models through one pay-as-you-go interface, so you don’t have to manage multiple subscriptions or provider accounts. It also offers privacy-conscious and crypto-friendly payment options.
United States
OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.
Comprehensive AI suite for Galaxy devices includes photo, video, and audio editing, generative and side-by-side tools, background noise removal, writing and note-taking assistance, AI-powered briefings, real-time info, content organization, and seamless device integration.
South Korea
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
United States
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
Australia
Chat with AI models, generate images, convert books into audiobooks, and run text-to-speech – all locally on your device. No cloud. No compromises.
Canada
