Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
- Global




The best Large Language Model (LLM) alternative to Jan.ai is ChatGPT, which is free. If that doesn't suit you, our users have ranked more than 100 alternatives to Jan.ai and loads of them are Large Language Model (LLM) Tools so hopefully you can find a suitable replacement. Other interesting Large Language Model (LLM) Tool alternatives to Jan.ai are Lumo by Proton, DeepSeek, Ollama and Mistral Vibe.
Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).




ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.




NanoGPT is a platform that gives you access to many AI models through one pay-as-you-go interface, so you don’t have to manage multiple subscriptions or provider accounts. It also offers privacy-conscious and crypto-friendly payment options.




Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

Combining Google's knowledge graph, ChatSonic delivers real-time data, voice interaction, AI-produced visual content, personalized avatars, and API for services. It revisits past dialogs for informed responses and integrates Twitter for chat responses. Supported in multiple languages on Android, iOS, and web.




Experience the power of AI at your fingertips with Private LLM, AI chatbot that runs on your iPhone, iPad and Mac without needing an internet connection.




MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.



OfflineLLM is unlimited, private, offline, 24/7, free access to AI. Augment your day-to-day life by using this Ai chatbot for a multiplicity of applications.



LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.


Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.




Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.



