local.ai Alternatives

local.ai is described as '🎒 local.ai - Run AI locally on your PC!' and is an app. There are more than 50 alternatives to local.ai for a variety of platforms, including Mac, Windows, Linux, Flathub and Android apps. The best local.ai alternative is Ollama, which is both free and Open Source. Other great apps like local.ai are Jan.ai, GPT4ALL, Ensu and Open WebUI.

Copy a direct link to this comment to your clipboard
local.ai alternatives page was last updated

Alternatives list

  1. apfel icon
     10 likes

    Access Apple’s local foundation model through a command-line tool with an OpenAI-compatible HTTP server, full function and schema calling, UNIX-friendly features, file attachments, JSON output, privacy-preserving on-device inference, and zero recurring costs.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Homebrew
     
  2. Onit AI icon
     10 likes

    Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
     
  3. Private GPT icon
     34 likes

    Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
     
  4. Newelle icon
     14 likes

    Deeply customizable virtual assistant offering flexible AI model support, voice chat, document interaction, web search, file and conversation management, extension integration, and a unified interface for organizing productivity and personal workflows.

    Cost / License

    Platforms

    • Linux
    • Flathub
    • Flatpak
     
  5. Tool for downloading AI and machine learning models from Hugging Face, Model Scope, and Civitai on Windows, featuring command line and GUI options, efficient management of large file downloads, integrity checks, and progress monitoring for users.

    Cost / License

    Platforms

    • Windows
     
  6. Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

    Cost / License

    Platforms

    • Mac
     
  7. OptiQ icon
     3 likes

    OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
     
  8. KoboldCpp icon
     11 likes

    KoboldCpp is an easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI...

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • Self-Hosted
     
  9. ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.

    Cost / License

    • Free Personal
    • Proprietary

    Platforms

    • Windows
    • NVIDIA vGPU
     
  10. Warden icon
     4 likes

    Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.

    Cost / License

    Platforms

    • Mac
     
You are at page 2 of local.ai alternatives