Open Source Ollama Alternatives
The best open source alternative to Ollama is Jan.ai. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are open source so hopefully you can find a suitable replacement. Other interesting open source alternatives to Ollama are Ensu, AnythingLLM, Alpaca - Ollama Client and Ollama App.
filter to find the best alternatives
Alternatives list
Built end-to-end by Tencent, Hy is a large language model engineered for excellence in content creation, reasoning, code, and conversation. From complex tasks in writing, research, and work, to everyday dialogue, knowledge, and creativity, Hy responds with precision, coherence...
China




- 70 Operit AI alternatives
📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱
Cost / License
- Free
- Open Source (LGPL-3.0)
Since
- Since 2026
China



- 6 Locally Uncensored alternatives
Open source local AI studio for Windows and Linux: chat, coding agent, image, video, music and LoRA training on your own hardware. Free locally.
Germany
EU


+1
Cortex is the open-source brain for robots: vision, speech, language, tabular, and action -- the cloud is optional.
Cost / License
- Free
- Open Source (Apache-2.0)
Since
- Since 2025
Singapore


Maestro Opera is an open-source AI assistant for Android, Windows, macOS and Linux that runs entirely on your own hardware. It works with on-device models, Google AI Core or Ollama, so your conversations never go through a third-party server and nothing is tracked.
France
EU



Nativ is a native macOS workspace for running AI models locally on Apple silicon. It bundles an mlx-vlm server, finds compatible models in your Hugging Face cache (honoring HF_HUB_CACHE and HF_HOME), and wraps the whole experience in a polished SwiftUI app.
Cost / License
- Free
- Open Source (MIT)
Since
- New


- 51 oxproxion alternatives
oxproxion is a versatile and user-centric Android chat application designed to interact with various Large Language Models (LLMs). It provides a seamless interface for managing conversations, customizing bot personas, and saving chat histories.
Cost / License
- Free
- Open Source (Apache-2.0)
Since
- New



Open-source AI platform for running LLMs entirely on your own infrastructure, with an OpenAI-compatible API, management dashboard, and zero data egress.
Cost / License
- Freemium (Subscription)
- Open Source (Apache-2.0)
Since
- Since 2026
Austria
EU

- 9 Janus API Router alternatives
Janus is a single Go binary that runs .gguf models on your machine and exposes an OpenAI-compatible API. Point Cursor, Cline, or any local or cloud LLM, or AI tool with compatible OpenAI API endpoints at localhost — no Python, no Docker.





















