Apps similar to MLC LLM include Lumo by Proton, which is open source with a free version. Other options are ChatGPT, Ollama, Claude and Google Gemini. There's no shortage of Large Language Model (LLM) Tools like MLC LLM, with more than 50 alternatives for Mac, Windows, iPhone, Linux and Android.
Runs fully private, offline chatbot entirely in browser, ensuring conversation data never leaves the device. No server, installation, external services, or account needed. Supports Llama 3, Mistral, and other open source models in a ChatGPT-like interface for privacy-focused users.
Cherry Studio is a desktop client that supports for multiple LLM providers, available on Windows, Mac, and Linux.
China
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
United States
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Bulgaria
EU
Unleash the power of artificial intelligence right at your fingertips with Chatbox, the versatile client application seamlessly integrated across all major platforms – Windows, Mac, Linux, Web, and iOS.
China
Together Chat is a next-generation consumer app designed to let you interact seamlessly with today's most popular open-source models, including free access to DeepSeek R1, securely hosted in the North America.
United States
Customizable interface for private, on-device AI model chatting, open source and closed source LLM connections, OpenRouter support, custom backend support, and unified access to language models without reliance on a single provider, ensuring privacy and flexibility.
United States
Raycast AI combines leading models with powerful extensions - right on your OS. Try a lite version of Raycast AI Chat for free.
United Kingdom
The simplest way to use private LLMs: Works fully offline and private when you don’t have internet. Runs models on-device optimized for Apple silicon.
United States
Complete LLM chatbot implementation, offering tokenization, pretraining, finetuning, evaluation, inference, and a simple web UI. Runs on a single 8xH100 node, features a hackable codebase, dependency-lite design, and automates the full workflow via scripts.
United States
