Private LLM Alternatives

Private LLM is described as 'Experience the power of AI at your fingertips with Private LLM, AI chatbot that runs on your iPhone, iPad and Mac without needing an internet connection' and is a large language model (llm) tool in the ai tools & services category. There are more than 50 alternatives to Private LLM for a variety of platforms, including Web-based, Mac, Windows, Linux and iPhone apps. The best Private LLM alternative is Jan.ai, which is both free and Open Source. Other great apps like Private LLM are GPT4ALL, AnythingLLM, Secret Llama and Alpaca - Ollama Client.

Copy a direct link to this comment to your clipboard
Private LLM alternatives page was last updated

Alternatives list

  1. Maid (AI) icon
     14 likes

    Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Android
    • Android Tablet
    • F-Droid
     
  2. apfel icon
     9 likes

    Access Apple’s local foundation model through a command-line tool with an OpenAI-compatible HTTP server, full function and schema calling, UNIX-friendly features, file attachments, JSON output, privacy-preserving on-device inference, and zero recurring costs.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Homebrew
     
  3. Private GPT icon
     34 likes

    Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

    285 Private GPT alternatives

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
     
  4. Apollo AI icon
     10 likes

    Customizable interface for private, on-device AI model chatting, open source and closed source LLM connections, OpenRouter support, custom backend support, and unified access to language models without reliance on a single provider, ensuring privacy and flexibility.

    83 Apollo AI alternatives

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Mac
    • iPhone
    • iPad
    • Android
     
  5. LlamaGPT icon
     28 likes

    LlamaGPT is a chatbot that provides a ChatGPT-like experience, with no data leaving your device.

    Cost / License

    • Free
    • Proprietary (MIT)

    Platforms

    • Software as a Service (SaaS)
     
  6. Reins icon
     12 likes

    Empowering LLM researchers and hobbyists with seamless control over self-hosted models. Connect remotely, customize prompts, manage chats, and fine-tune configurations. All in one intuitive app.

    Cost / License

    Platforms

    • Mac
    • iPhone
    • iPad
    • Linux
    • Flathub
    • Flatpak
     
  7. nanochat icon
     9 likes

    Complete LLM chatbot implementation, offering tokenization, pretraining, finetuning, evaluation, inference, and a simple web UI. Runs on a single 8xH100 node, features a hackable codebase, dependency-lite design, and automates the full workflow via scripts.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Self-Hosted
    • Python
     
  8. Newelle icon
     14 likes

    Deeply customizable virtual assistant offering flexible AI model support, voice chat, document interaction, web search, file and conversation management, extension integration, and a unified interface for organizing productivity and personal workflows.

    Cost / License

    Platforms

    • Linux
    • Flathub
    • Flatpak
     
  9. ChatSonic icon
     48 likes

    Combining Google's knowledge graph, ChatSonic delivers real-time data, voice interaction, AI-produced visual content, personalized avatars, and API for services. It revisits past dialogs for informed responses and integrates Twitter for chat responses. Supported in multiple languages on Android, iOS, and web.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Google Chrome
     
  10. Yoink AI icon
     6 likes

    Yoink AI automatically gains context of whatever you are writing, wherever you are writing. No need to toggle tabs or copy-paste. Let AI come to you instead.

    Cost / License

    • Freemium
    • Proprietary

    Application types

    Platforms

    • Mac
     
  11. Backyard AI icon
     15 likes

    Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
     
  12. Lekh AI icon
     4 likes

    Chat with AI models, generate images, convert books into audiobooks, and run text-to-speech – all locally on your device. No cloud. No compromises.

    57 Lekh AI alternatives

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Mac
    • iPhone
    • iPad
     
You are at page 2 of Private LLM alternatives