Ollama AlternativesOnly apps categorised as Large Language Model (LLM) Tools - Page 2

The best Large Language Model (LLM) alternative to Ollama is Jan.ai, which is both free and Open Source. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are Large Language Model (LLM) Tools so hopefully you can find a suitable replacement. Other interesting Large Language Model (LLM) Tool alternatives to Ollama are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. llama.cpp icon
     12 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    43 llama.cpp alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    Good alternative?
     
    |
    1
  2. AgentGPT icon
     20 likes

    AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

    Cost / License

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  3. LocalAI  icon
     12 likes

    Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

    78 LocalAI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    • Self-Hosted
    • Cloudron
    Good alternative?
     
  4. NodeTool icon
     10 likes

    NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

    52 NodeTool alternatives

    Cost / License

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  5. OptiQ icon
     5 likes

    OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
  6. Mocolamma icon
     7 likes

    Mocolamma is an Ollama management application for macOS and iOS / iPadOS that connects to Ollama servers to manage models and perform chat tests using models stored on the Ollama server.

    Cost / License

    • Pay once
    • Open Source (MIT)

    Application type

    Since

    • Since 2025

    Platforms

    • Mac
    • iPhone
    • iPad
    • visionOS
    Good alternative?
     
  7. Backyard AI icon
     15 likes

    Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.

    242 Backyard AI alternatives

    Cost / License

    • Free
    • Proprietary

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  8. Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

    Cost / License

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
  9. SuperAGI icon
     5 likes

    A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  10. MLC LLM icon
     4 likes

    MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.

    Cost / License

    Application type

    Since

    • Since 2025

    Platforms

    • Windows
    • Mac
    • Linux
    • Online
    • Android
    • iPhone
    • iPad
    • Python
    Good alternative?
     
  11. oMLX icon
     5 likes

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

    56 oMLX alternatives

    Cost / License

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
You are at page 2 of Ollama alternatives