Ollama is not available as a self-hosted solution but there are plenty of alternatives for power users and business that want to host a solution on-premise. The best Self-Hosted alternative is AnythingLLM, which is both free and Open Source. If that doesn't suit you, our users have ranked more than 50 alternatives to Ollama and 17 are available as a self-hosted solution so hopefully you can find a suitable replacement. Other interesting Self-Hosted alternatives to Ollama are Instella, Auto-GPT, MiroThinker and LocalAI .
Open-source privacy-focused chatbot platform allowing unlimited document uploads, multi-user and single-user modes, AI-powered chat with documents, vector database and LLM compatibility, customizable interface, message history, secure desktop deployment, and full user controls.
Instella, a large language model tool developed by AMD, provides exceptional performance with open access to model weights and training data, promoting advancements in AI. It bridges the gap between fully open and open weight models by outperforming competitors like Llama-3.2-3B.
MiroThinker is an open-source search agent model, built for tool-augmented reasoning and real-world information seeking, aiming to match the deep research experience of OpenAI Deep Research and Gemini Deep Research.
Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).
This Python script is an example of an AI-powered task management system. The system uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks. The main idea behind this system is that it creates tasks based on the result of previous tasks and a predefined objective.
Embeddings databases are a union of vector indexes (sparse and dense), graph networks and relational databases. This enables vector search with SQL, topic modeling, retrieval augmented generation and more.
LanceDB is an open-source database for vector-search built with persistent storage, which greatly simplifies retrieval, filtering and management of embeddings.
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...
Marqo is an AI-native ecommerce search and product discovery platform built for retail brands in fashion, beauty, footwear, and home goods.
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
United States
Singapore
Japan
China
Australia
Not a LLM tool, just a LLM.