Ollama Alternatives

Apps similar to Ollama include Jan.ai, which is free and open source. Other options are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client. There's no shortage of Large Language Model (LLM) Tools like Ollama, with more than 100 alternatives for Mac, Windows, Linux, the web and Android.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. BabyAGI icon
     13 likes

    This Python script is an example of an AI-powered task management system. The system uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks. The main idea behind this system is that it creates tasks based on the result of previous tasks and a predefined objective.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Self-Hosted
    Good alternative?
     
  2. Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

    Cost / License

    Platforms

    • Mac
    Good alternative?
     
  3.  6 likes

    The Swiss Army Knife of offline AI. Chat, speak, and generate images. Privacy first, zero internet. Download an LLM and use it on your mobile device. No data ever leaves your phone.

    79 Off Grid AI alternatives

    Cost / License

    • Freemium
    • Open Source (MIT)

    Platforms

    • Android
    • iPhone
    • Mac
    • Windows
    Good alternative?
     
  4. ChatMCP icon
     2 likes

    ChatMCP is a cross-platform AI chat client built with Flutter that integrates with Model Context Protocol (MCP) servers to provide enhanced AI interactions. This document provides a high-level overview of the system architecture, core components, and technology stack that powers...

    Cost / License

    Platforms

    • Windows
    • Mac
    • Android
    • Online
    • iPhone
    • Linux
    Good alternative?
     
  5. SuperAGI icon
     5 likes

    A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    Good alternative?
     
  6. GPT Engineer icon
     5 likes

    GPT Engineer is a ChatGPT agent designed to code based on how you want it to. It generates an entire codebase based on a prompt along with some feedback.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Linux
    Good alternative?
     
  7. Synthflow AI icon
     3 likes

    Empower any business with no-code AI voice assistants, enabling seamless outbound/inbound calls and appointments. Personalize user experiences with conversational AI while ensuring top-notch privacy and security across diverse applications.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    Good alternative?
     
  8. txtai icon
     2 likes

    Embeddings databases are a union of vector indexes (sparse and dense), graph networks and relational databases. This enables vector search with SQL, topic modeling, retrieval augmented generation and more.

    Cost / License

    Platforms

    • Self-Hosted
    • Docker
    Good alternative?
     
  9. Warden icon
     4 likes

    Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.

    Cost / License

    Application type

    Platforms

    • Mac
    Good alternative?
     
  10. MLC LLM icon
     3 likes

    MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    • Android
    • iPhone
    • iPad
    • Python
    Good alternative?
     
  11. oMLX icon
     4 likes

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

    Cost / License

    Platforms

    • Mac
    Good alternative?
     
You are at page 3 of Ollama alternatives