Ollama Alternatives

Apps similar to Ollama include Jan.ai, which is free and open source. Other options are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client. There's no shortage of Large Language Model (LLM) Tools like Ollama, with more than 100 alternatives for Mac, Windows, Linux, the web and Android.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. Create your own custom chat assists to boost your productivity with ChatGPT.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Android
    Good alternative?
     
    |
    1
  2. Ollaya icon
     3 likes

    Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.

    51 Ollaya alternatives

    Cost / License

    Platforms

    • Mac
    • Linux
    • Windows
    • Docker
    Good alternative?
     
  3. ChaptersAI is a chat client for OpenAI's GPT that lets you branch off any paragraph into a separate chat window. It's useful for building large projects and drilling down into the component parts, and then being able to go back up to the original chat context.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    Good alternative?
     
  4. ANIE icon
     1 like

    Experience AI chat on macOS with a SwiftUI-designed client utilizing Swift, CoreML, and BERT for native performance. Enjoy privacy-focused, intuitive chats with intelligent AI responses, profile customization, and full control via editable chat history and message rewind.

    Cost / License

    • Free
    • Proprietary

    Application type

    Platforms

    • Mac
    Good alternative?
     
  5. Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    Good alternative?
     
  6. LanceDB icon
     2 likes

    LanceDB is an open-source database for vector-search built with persistent storage, which greatly simplifies retrieval, filtering and management of embeddings.

    Cost / License

    Platforms

    • Self-Hosted
    Good alternative?
     
  7. Osaurus icon
     5 likes

    Local AI agents on your Mac. Private, offline, free. Open models run on Apple Silicon; add ChatGPT, Claude or Gemini only when you choose.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Mac
    Good alternative?
     
  8. Laria icon
     1 like

    Your private and offline AI companion. Chat and generate images locally !.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Android
    Good alternative?
     
  9. Dione icon
     4 likes

    Dione makes installing complex applications as simple as clicking a button — no terminal or technical knowledge needed. For developers, Dione offers a zero-friction way to distribute apps using just a JSON file. App installation has never been this effortless.

    Cost / License

    • Free
    • Open Source (MIT)

    Alerts

    • Discontinued

    Platforms

    • Mac
    • Windows
    • Linux
    Good alternative?
     
  10. RWKV Chat icon
     3 likes

    Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • Android
    • iPhone
    • iPad
    • Android Tablet
    Good alternative?
     
You are at page 4 of Ollama alternatives