Open Source Ollama Alternatives

The best open source alternative to Ollama is Jan.ai. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are open source so hopefully you can find a suitable replacement. Other interesting open source alternatives to Ollama are Ensu, AnythingLLM, Alpaca - Ollama Client and Ollama App.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. Osaurus icon
     5 likes

    Local AI agents on your Mac. Private, offline, free. Open models run on Apple Silicon; add ChatGPT, Claude or Gemini only when you choose.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2025

    Platforms

    • Mac
    Good alternative?
     
  2. Dione icon
     4 likes

    Dione makes installing complex applications as simple as clicking a button — no terminal or technical knowledge needed. For developers, Dione offers a zero-friction way to distribute apps using just a JSON file. App installation has never been this effortless.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2025

    Alerts

    • Discontinued

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  3. Follamac icon
     5 likes

    You need Ollama running on your localhost with some model. Once Ollama is running the model can be pulled from Follamac or from command line. From command line type something like: Ollama pull llama3 If you wish to pull from Follamac you can write llama3 into "Model name to...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2024

    Platforms

    • Windows
    • Mac
    • Linux
    • BSD
    • Flathub
    • Flatpak
    Good alternative?
     
  4. autotab icon
     3 likes

    Welcome to autotab! autotab makes it easy to create auditable browser automations using AI. Go from a point & click demonstration in the browser to live code for those actions in seconds.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2023

    Platforms

    • Windows
    • Mac
    • Linux
    • Google Chrome
    Good alternative?
     
  5. GPTMobile icon
     2 likes

    Chat Assistant for Android that supports chatting with multiple models at once.

    Cost / License

    Application type

    Since

    • Since 2024

    Platforms

    • Android
    • F-Droid
    • OpenAPK
    Good alternative?
     
  6. 5ire icon
     2 likes

    5ire is a cross-platform desktop AI assistant, MCP client. It compatible with major service providers, supports local knowledge base and tools via model context protocol servers .

    Cost / License

    • Free
    • Open Source

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  7. Council icon
     3 likes

    Council is an open-source platform for rapidly developing customized generative AI applications using collaborating ‘agents’.

    Cost / License

    Application type

    Since

    • Since 2023

    Platforms

    • Windows
    • Mac
    • Linux
    • Online
    • Software as a Service (SaaS)
    • Self-Hosted
    Good alternative?
     
  8. SmolChat icon
     2 likes

    SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

    Cost / License

    Since

    • Since 2026

    Platforms

    • Android
    Good alternative?
     
  9. PostgreSQL vector database extension for building AI applications.

    Cost / License

    Application type

    Since

    • Since 2023

    Platforms

    • Self-Hosted
    Good alternative?
     
  10. FastFlowLM icon
     2 likes

    Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

    Cost / License

    • Free Personal
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Online
    • Self-Hosted
    Good alternative?
     
  11. Foundry Local icon
     3 likes

    Run AI models locally on your device. Foundry Local provides on-device inference with complete data privacy, no Azure subscription required.

    Cost / License

    • Free
    • Open Source

    Since

    • Since 2025

    Platforms

    • Windows
    • Mac
    Good alternative?
     
  12. AI Playground icon
     3 likes

    This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    Good alternative?
     
You are at page 4 of Ollama alternatives