Ollama AlternativesOnly apps categorised as Large Language Model (LLM) Tools - Page 4

The best Large Language Model (LLM) alternative to Ollama is Jan.ai, which is both free and Open Source. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are Large Language Model (LLM) Tools so hopefully you can find a suitable replacement. Other interesting Large Language Model (LLM) Tool alternatives to Ollama are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client.

filter to find the best alternatives

Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Copy a direct link to this comment to your clipboard
Alternatives
Ollama alternatives page was last updated

Alternatives list

  1. FastFlowLM icon
     2 likes

    Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

    Cost / License

    • Free Personal
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    • Online
    • Self-Hosted
    Good alternative?
     
  2. AI Playground icon
     3 likes

    This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Since

    • Since 2026

    Platforms

    • Windows
    Good alternative?
     
  3. AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Rust
    Good alternative?
     
  4. Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Windows
    Good alternative?
     
  5. Nexa Studio icon
     2 likes

    Nexa Studio: Offline, Private AI with Unlimited Use.

    Cost / License

    • Free
    • Proprietary

    Since

    • Since 2026

    Platforms

    • Android
    Good alternative?
     
  6. RWKV Runner icon
     2 likes

    This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Python
    Good alternative?
     
  7. A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

    16 vllm-playground alternatives

    Cost / License

    Since

    • Since 2026

    Platforms

    • Mac
    • Linux
    • Self-Hosted
    • Python
    • Kubernetes
    • OpenShift
    Good alternative?
     
  8. Empler AI icon
     2 likes

    Automate Unresolved Go-to-Market Challenges and Empower Your CRM, Marketing, and Sales Teams to Achieve Desired Results with Multi-agent Framework, B2B Database Creation, Agentic Workflows, and Integrations.

    Cost / License

    • Freemium (Pay once)
    • Proprietary

    Application type

    Since

    • Since 2023

    Platforms

    • Online
    Good alternative?
     
  9. Jellybox icon
     1 like

    Run AI models locally and entirely offline.

    Cost / License

    • Free
    • Proprietary

    Since

    • Since 2024

    Platforms

    • Windows
    • Mac
    Good alternative?
     
  10. Strata AI icon
     1 like

    Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

    3 Strata AI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  11. Ekorbia icon
     1 like

    Ekorbia is a native desktop Integrated Chat and Productivity Environment for local AI models powered by Ollama. Features include chat history, full-text search, prompt library, model comparison chat mode, chat overlay, ephemeral chat, file watches and more.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Mac
    Good alternative?
     
  12. Tencent Hy icon
     1 like

    Built end-to-end by Tencent, Hy is a large language model engineered for excellence in content creation, reasoning, code, and conversation. From complex tasks in writing, research, and work, to everyday dialogue, knowledge, and creativity, Hy responds with precision, coherence...

    Cost / License

    • Free
    • Open Source

    Since

    • Since 2026

    Platforms

    • Windows
    • Mac
    • Linux
    • Online
    • Self-Hosted
    • Python
    Good alternative?
     
You are at page 4 of Ollama alternatives