Ollama Alternatives

Apps similar to Ollama include Jan.ai, which is free and open source. Other options are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client. There's no shortage of Large Language Model (LLM) Tools like Ollama, with more than 100 alternatives for Mac, Windows, Linux, the web and Android.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. Instella icon
     8 likes

    Instella, a large language model tool developed by AMD, provides exceptional performance with open access to model weights and training data, promoting advancements in AI. It bridges the gap between fully open and open weight models by outperforming competitors like Llama-3.2-3B.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Self-Hosted
    • Docker
    • PyTorch
    Good alternative?
     
    |
    1
  2. AgentGPT icon
     19 likes

    AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

    Cost / License

    Application type

    Platforms

    • Online
    Good alternative?
     
  3. Devika icon
     18 likes

    Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika utilizes large language models, planning and reasoning algorithms, and...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    Good alternative?
     
  4. llama.cpp icon
     9 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    38 llama.cpp alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Windows
    • Mac
    • Linux
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    • Self-Hosted
    Good alternative?
     
  5. Devin icon
     18 likes

    Devin is an autonomous agent that solves engineering tasks through the use of its own shell, code editor, and web browser.

    40 Devin alternatives

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
    • US flagUnited States
    Devin screenshot 1
    Good alternative?
     
  6.  16 likes

    Auto-GPT is an experimental open-source application showcasing the capabilities of the GPT-4 language model. This program, driven by GPT-4, chains together LLM "thoughts", to autonomously achieve whatever goal you set.

    60 Auto-GPT alternatives

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Self-Hosted
    Good alternative?
     
  7. LocalAI  icon
     12 likes

    Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

    77 LocalAI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    • Self-Hosted
    • Cloudron
    Good alternative?
     
  8. MiroThinker icon
     11 likes

    MiroThinker is an open-source search agent model, built for tool-augmented reasoning and real-world information seeking, aiming to match the deep research experience of OpenAI Deep Research and Gemini Deep Research.

    89 MiroThinker alternatives

    Cost / License

    Application type

    Platforms

    • Python
    • Windows
    • Linux
    • Mac
    • Self-Hosted
    Good alternative?
     
  9. NodeTool icon
     10 likes

    NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    Good alternative?
     
  10. Mocolamma icon
     7 likes

    Mocolamma is an Ollama management application for macOS and iOS / iPadOS that connects to Ollama servers to manage models and perform chat tests using models stored on the Ollama server.

    Cost / License

    • Paid
    • Open Source (MIT)

    Application type

    Platforms

    • Mac
    • iPhone
    • iPad
    • visionOS
    Good alternative?
     
  11. OptiQ icon
     5 likes

    OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    Good alternative?
     
You are at page 2 of Ollama alternatives