Open Source Ollama Alternatives

The best open source alternative to Ollama is Jan.ai. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are open source so hopefully you can find a suitable replacement. Other interesting open source alternatives to Ollama are Ensu, AnythingLLM, Alpaca - Ollama Client and Ollama App.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1.  1 like

    Framework for building actionable agents to achieve goals specified by user, powered by OpenAI GPT-4 and GPT-3.5.

    Cost / License

    • Free
    • Open Source

    Since

    • Since 2023

    Platforms

    • Windows
    • Linux
    Good alternative?
     
  2. Tencent Hy icon
     1 like

    Built end-to-end by Tencent, Hy is a large language model engineered for excellence in content creation, reasoning, code, and conversation. From complex tasks in writing, research, and work, to everyday dialogue, knowledge, and creativity, Hy responds with precision, coherence...

    Cost / License

    • Free
    • Open Source

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Online
    • Self-Hosted
    • Python
    Good alternative?
     
  3.  1 like

    oterm is the text-based terminal client for Ollama.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2024

    Platforms

    • Windows
    • Mac
    • Linux
    • BSD
    • Python
    • Homebrew
    Good alternative?
     
  4. Operit AI icon
     1 like

    📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱

    70 Operit AI alternatives

    Cost / License

    Since

    • Since 2026

    Platforms

    • Android
    Good alternative?
     
  5. Open source local AI studio for Windows and Linux: chat, coding agent, image, video, music and LoRA training on your own hardware. Free locally.

    6 Locally Uncensored alternatives

    Cost / License

    Application type

    Since

    • New

    Platforms

    • Windows
    • Linux
    Good alternative?
     
  6. RamaLama icon
     1 like

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2025

    Platforms

    • Mac
    • Linux
    • Python
    Good alternative?
     
  7. Cortex.cpp icon
     1 like

    Cortex is the open-source brain for robots: vision, speech, language, tabular, and action -- the cloud is optional.

    Cost / License

    Since

    • Since 2025

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  8. Maestro Opera is an open-source AI assistant for Android, Windows, macOS and Linux that runs entirely on your own hardware. It works with on-device models, Google AI Core or Ollama, so your conversations never go through a third-party server and nothing is tracked.

    Cost / License

    Application type

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    Good alternative?
     
  9. Nativ icon
     Like

    Nativ is a native macOS workspace for running AI models locally on Apple silicon. It bundles an mlx-vlm server, finds compatible models in your Hugging Face cache (honoring HF_HUB_CACHE and HF_HOME), and wraps the whole experience in a polished SwiftUI app.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • New

    Platforms

    • Mac
    Good alternative?
     
  10. oxproxion icon
     Like

    oxproxion is a versatile and user-centric Android chat application designed to interact with various Large Language Models (LLMs). It provides a seamless interface for managing conversations, customizing bot personas, and saving chat histories.

    51 oxproxion alternatives

    Cost / License

    Since

    • New

    Platforms

    • Android
    • F-Droid
    • OpenAPK
    Good alternative?
     
  11. Xinity AI icon
     Like

    Open-source AI platform for running LLMs entirely on your own infrastructure, with an OpenAI-compatible API, management dashboard, and zero data egress.

    Cost / License

    Since

    • Since 2026

    Platforms

    • Online
    • Software as a Service (SaaS)
    • Self-Hosted
    • Docker
    Good alternative?
     
  12. Janus is a single Go binary that runs .gguf models on your machine and exposes an OpenAI-compatible API. Point Cursor, Cline, or any local or cloud LLM, or AI tool with compatible OpenAI API endpoints at localhost — no Python, no Docker.

    9 Janus API Router alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
You are at page 6 of Ollama alternatives