Open Source Ollama Alternatives

The best open source alternative to Ollama is Jan.ai. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are open source so hopefully you can find a suitable replacement. Other interesting open source alternatives to Ollama are Ensu, AnythingLLM, Alpaca - Ollama Client and Ollama App.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. llama.cpp icon
     12 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    43 llama.cpp alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    Good alternative?
     
    |
    1
  2. AgentGPT icon
     20 likes

    AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

    Cost / License

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  3. AutoGPT icon
     17 likes

    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

    Cost / License

    • Free Personal
    • Open Source

    Application type

    Since

    • Since 2023

    Platforms

    • Self-Hosted
    • Docker
    • Docker Hub
    Good alternative?
     
  4. Devika icon
     18 likes

    Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika utilizes large language models, planning and reasoning algorithms, and...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2024

    Platforms

    • Online
    Good alternative?
     
  5. LocalAI  icon
     12 likes

    Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

    78 LocalAI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    • Self-Hosted
    • Cloudron
    Good alternative?
     
  6. MiroThinker icon
     11 likes

    MiroThinker is an open-source search agent model, built for tool-augmented reasoning and real-world information seeking, aiming to match the deep research experience of OpenAI Deep Research and Gemini Deep Research.

    91 MiroThinker alternatives

    Cost / License

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Python
    Good alternative?
     
  7. Ollaya icon
     4 likes

    Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.

    Cost / License

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    • Docker
    Good alternative?
     
  8. NodeTool icon
     10 likes

    NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

    52 NodeTool alternatives

    Cost / License

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  9. OptiQ icon
     5 likes

    OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
  10. BabyAGI icon
     13 likes

    This Python script is an example of an AI-powered task management system. The system uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks. The main idea behind this system is that it creates tasks based on the result of previous tasks and a predefined objective.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Self-Hosted
    Good alternative?
     
  11. Mocolamma icon
     7 likes

    Mocolamma is an Ollama management application for macOS and iOS / iPadOS that connects to Ollama servers to manage models and perform chat tests using models stored on the Ollama server.

    Cost / License

    • Pay once
    • Open Source (MIT)

    Application type

    Since

    • Since 2025

    Platforms

    • Mac
    • iPhone
    • iPad
    • visionOS
    Good alternative?
     
  12. Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

    Cost / License

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
You are at page 2 of Ollama alternatives