Apps similar to AnythingLLM include ChatGPT, which has a free version. Other options are Lumo by Proton, DeepSeek, Ollama and Claude. AI Chatbots like AnythingLLM are a crowded field, with more than 100 alternatives for Mac, the web, Windows, Linux and iPhone.
Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.
United States
Customizable interface for private, on-device AI model chatting, open source and closed source LLM connections, OpenRouter support, custom backend support, and unified access to language models without reliance on a single provider, ensuring privacy and flexibility.
United States
NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.
Germany
EU
Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.
Empowering LLM researchers and hobbyists with seamless control over self-hosted models. Connect remotely, customize prompts, manage chats, and fine-tune configurations. All in one intuitive app.
Türkiye
India
OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.
China
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
Auto-GPT is an experimental open-source application showcasing the capabilities of the GPT-4 language model. This program, driven by GPT-4, chains together LLM "thoughts", to autonomously achieve whatever goal you set.
An experimental open-source attempt to make GPT-4 fully autonomous.
