Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
Cost / License
- Free Personal
- Open Source (MIT)
Application typeApplication types
Platforms
- Windows
- Online
- Self-Hosted
Ollama Alternatives
Apps similar to Ollama include Jan.ai, which is free and open source. Other options are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client. There's no shortage of Large Language Model (LLM) Tools like Ollama, with more than 100 alternatives for Mac, Windows, Linux, the web and Android.
filter to find the best alternatives
Most Ollama alternatives are Large Language Model (LLM) Tools, but you can also narrow the list to AI Chatbots or AI Writing Tools. Another popular filter is Open Source. You can also filter for EU-based alternatives if you prefer software from the European Union.
Alternatives list
Run AI models locally on your device. Foundry Local provides on-device inference with complete data privacy, no Azure subscription required.
Cost / License
- Free
- Open Source
Platforms
- Windows
- Mac
Cost / License
- Free
- Open Source (AGPL-3.0)
Platforms
- Self-Hosted
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Windows
- Mac
- Linux
- Rust
Cost / License
- Free
- Proprietary
Application type
Platforms
- Android
United States
This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Mac
- Windows
- Linux
- Self-Hosted
- Python
China
+8
This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...
Cost / License
- Free
- Open Source (MIT)
Application typeApplication types
Platforms
- Windows
- United States
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Windows
- Linux
- Docker
- Snapcraft
- iPhone
- iPad
- Self-Hosted
- Python
- United States
+1
Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Windows
- United States
+1
A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Python
- Mac
- Linux
- Self-Hosted
- Kubernetes
- OpenShift
Australia
+1
LM-Kit.NET is a versatile SDK for integrating Large Language Models (LLM) into C# applications. It provides advanced AI features like text generation, Natural Language Processing (NLP), data retrieval, content enhancement, and translation, enabling diverse industry use cases with ease.
Cost / License
- Free Personal
- Proprietary
Application type
Platforms
- Windows
- Mac
- Linux
+5
Inferencer lets you run, host and deeply control the latest SOTA AI models (OSS, DeepSeek, Qwen, Kimi, GLM, MiniMax and more) from your own computer.
Cost / License
- Freemium
- Proprietary
Application typeApplication types
Platforms
- Mac
- iPhone
- iPad
- Australia
+5
