Ollama Alternatives

Apps similar to Ollama include Jan.ai, which is free and open source. Other options are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client. There's no shortage of Large Language Model (LLM) Tools like Ollama, with more than 100 alternatives for Mac, Windows, Linux, Android and the web.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. BabyAGI icon
     13 likes

    This Python script is an example of an AI-powered task management system. The system uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks. The main idea behind this system is that it creates tasks based on the result of previous tasks and a predefined objective.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Self-Hosted
    Good alternative?
     
  2. Mocolamma icon
     7 likes

    Mocolamma is an Ollama management application for macOS and iOS / iPadOS that connects to Ollama servers to manage models and perform chat tests using models stored on the Ollama server.

    Cost / License

    • Pay once
    • Open Source (MIT)

    Application type

    Since

    • Since 2025

    Platforms

    • Mac
    • iPhone
    • iPad
    • visionOS
    Good alternative?
     
  3. Backyard AI icon
     15 likes

    Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.

    242 Backyard AI alternatives

    Cost / License

    • Free
    • Proprietary

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  4. Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

    Cost / License

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
  5. Off Grid AI icon
     6 likes

    The Swiss Army Knife of offline AI. Chat, speak, and generate images. Privacy first, zero internet. Download an LLM and use it on your mobile device. No data ever leaves your phone.

    87 Off Grid AI alternatives

    Cost / License

    • Freemium (Pay once or Subscription)
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    • iPhone
    Good alternative?
     
  6. ChatMCP icon
     2 likes

    ChatMCP is a cross-platform AI chat client built with Flutter that integrates with Model Context Protocol (MCP) servers to provide enhanced AI interactions. This document provides a high-level overview of the system architecture, core components, and technology stack that powers...

    Cost / License

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Online
    • Android
    • iPhone
    Good alternative?
     
  7. SuperAGI icon
     5 likes

    A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  8. MLC LLM icon
     4 likes

    MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.

    Cost / License

    Application type

    Since

    • Since 2025

    Platforms

    • Windows
    • Mac
    • Linux
    • Online
    • Android
    • iPhone
    • iPad
    • Python
    Good alternative?
     
  9. oMLX icon
     5 likes

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

    56 oMLX alternatives

    Cost / License

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
  10. GPT Engineer icon
     5 likes

    GPT Engineer is a ChatGPT agent designed to code based on how you want it to. It generates an entire codebase based on a prompt along with some feedback.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2023

    Platforms

    • Windows
    • Linux
    Good alternative?
     
  11. RWKV Chat icon
     4 likes

    Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.

    Cost / License

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    • iPhone
    • iPad
    • Android Tablet
    Good alternative?
     
You are at page 3 of Ollama alternatives