Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
Cost / License
- Free Personal
- Open Source
Application types
United StatesPlatforms
- Windows
- Online
- Self-Hosted
Ollama Alternatives
Ollama is described as 'Facilitates local deployment of Llama 3, Code Llama, and other language models, enabling customization and offline AI development. Perfect for creating personalized AI chatbots and writing tools' and is a very popular large language model (llm) tool in the ai tools & services category. There are more than 50 alternatives to Ollama for a variety of platforms, including Mac, Windows, Linux, Android and Web-based apps. The best Ollama alternative is DeepSeek, which is both free and Open Source. Other great apps like Ollama are Jan.ai, AnythingLLM, Ensu and Alpaca - Ollama Client.
filter to find the best alternatives
Ollama alternatives are mainly Large Language Model (LLM) Tools, but if you're looking for AI Chatbots or AI Writing Tools you can filter on that. Other popular filters include Open Source. You can also filter by region, for example EU-based alternatives if you prefer software developed in the European Union. These are just examples - use the filter bar below to find more specific alternatives to Ollama.
Alternatives list
26 FastFlowLM alternatives
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
17 Lemonade Server alternativesLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Windows
- Linux
- Docker
- Snapcraft
- iPhone
- iPad
- Self-Hosted
- Python
+1
Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...
+1
+1
Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Mac
- Windows
- Linux
- Android
- iPhone
- iPad
- Android Tablet
+5
+1
This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...
This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...
+8
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Python
- Mac
- Linux
- Self-Hosted
- Kubernetes
- OpenShift
+1
Cost / License
- Free
- Proprietary
Platforms
- Mac
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.
Cost / License
- Free
- Open Source (MIT)
Platforms
- Windows
- Mac
- Linux
- Android
China
Australia
Norway
