Ollama Alternatives

Apps similar to Ollama include Jan.ai, which is free and open source. Other options are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client. There's no shortage of Large Language Model (LLM) Tools like Ollama, with more than 100 alternatives for Mac, Windows, Linux, Android and the web.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. Instella icon
     8 likes

    Instella, a large language model tool developed by AMD, provides exceptional performance with open access to model weights and training data, promoting advancements in AI. It bridges the gap between fully open and open weight models by outperforming competitors like Llama-3.2-3B.

    Cost / License

    • Free
    • Open Source

    Since

    • Since 2025

    Platforms

    • Self-Hosted
    • Docker
    • PyTorch
    Good alternative?
     
    |
    1
  2. llama.cpp icon
     12 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    43 llama.cpp alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    Good alternative?
     
    |
    1
  3. AgentGPT icon
     20 likes

    AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

    Cost / License

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  4. Nectar GPT icon
     18 likes

    An experimental open-source attempt to make GPT-4 fully autonomous.

    Cost / License

    • Free
    • Proprietary

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    • Google Chrome
    • Mozilla Firefox
    • Microsoft Edge
    Good alternative?
     
  5. AutoGPT icon
     17 likes

    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

    Cost / License

    • Free Personal
    • Open Source

    Application type

    Since

    • Since 2023

    Platforms

    • Self-Hosted
    • Docker
    • Docker Hub
    Good alternative?
     
  6. Devika icon
     18 likes

    Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika utilizes large language models, planning and reasoning algorithms, and...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2024

    Platforms

    • Online
    Good alternative?
     
  7. LocalAI  icon
     12 likes

    Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

    78 LocalAI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    • Self-Hosted
    • Cloudron
    Good alternative?
     
  8. Devin icon
     18 likes

    Devin is an autonomous agent that solves engineering tasks through the use of its own shell, code editor, and web browser.

    Cost / License

    • Pay once
    • Proprietary

    Application type

    Since

    • Since 2024

    Platforms

    • Online
    • US flagUnited States
    Devin screenshot 1
    Good alternative?
     
  9. MiroThinker icon
     11 likes

    MiroThinker is an open-source search agent model, built for tool-augmented reasoning and real-world information seeking, aiming to match the deep research experience of OpenAI Deep Research and Gemini Deep Research.

    91 MiroThinker alternatives

    Cost / License

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Python
    Good alternative?
     
  10. Ollaya icon
     4 likes

    Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.

    Cost / License

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    • Docker
    Good alternative?
     
  11. NodeTool icon
     10 likes

    NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

    52 NodeTool alternatives

    Cost / License

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  12. OptiQ icon
     5 likes

    OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
You are at page 2 of Ollama alternatives