Foundry Local Alternatives

Foundry Local is described as 'Run AI models locally on your device. Foundry Local provides on-device inference with complete data privacy, no Azure subscription required' and is an app. There are nine alternatives to Foundry Local for a variety of platforms, including Windows, Linux, Mac, Docker and Flatpak apps. The best Foundry Local alternative is Ollama, which is both free and Open Source. Other great apps like Foundry Local are Jan.ai, Open WebUI, AnythingLLM and LM Studio.

Copy a direct link to this comment to your clipboard
Foundry Local alternatives page was last updated

Alternatives list

  1. Ollama icon
     131 likes

    Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.

    84 Ollama alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
     
  2. Jan.ai icon
     99 likes

    Open-source offline AI platform supports local LLMs including Llama, Gemma, Qwen, GPT-oss, integrates cloud services like OpenAI and Anthropic, enables custom assistant creation, offers OpenAI-compatible API on localhost, operates across diverse hardware and ensures privacy.

    232 Jan.ai alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    • Flathub
    • Flatpak
     
  3. Open WebUI icon
     46 likes

    Feature-rich offline AI platform with support for Ollama and OpenAI-compatible APIs, retrieval-augmented generation, text-to-image, cloud sync, privacy focus, ad-free experience, distraction-free and dark modes, no registration, easy deployment, and customizable UI.

    37 Open WebUI alternatives

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
    • Self-Hosted
    • Cloudron
    • Docker
     
  4. AnythingLLM icon
     45 likes

    Open-source privacy-focused chatbot platform allowing unlimited document uploads, multi-user and single-user modes, AI-powered chat with documents, vector database and LLM compatibility, customizable interface, message history, secure desktop deployment, and full user controls.

    204 AnythingLLM alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Self-Hosted
    • Docker
     
  5. local.ai icon
     21 likes

    🎒 local.ai - Run AI locally on your PC!.

    Cost / License

    Alerts

    • Discontinued

    Platforms

    • Mac
    • Windows
    • Linux
     
  6.  1 like

    A local device focused AI assistant built in Rust — persistent memory, autonomous tasks, ~27MB binary. Inspired by and compatible with OpenClaw.

    Cost / License

    Application type

    Platforms

    • Rust
    • Mac
    • Linux
    • Windows
    • BSD
    • Docker
    • Node.JS
     
  7. QVAC converts local AI into a high-quality experience that sits in your pocket. All the value you’re used to seeing in other AI assistants, minus the lack of privacy.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Mac
    • Linux
    • Windows
    • Flathub
    • Flatpak
     
9 of 9 Foundry Local alternatives