The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Bulgaria
EU




The best Large Language Model (LLM) alternative to Ollama is Jan.ai, which is both free and Open Source. If that doesn't suit you, our users have ranked more than 100 alternatives to Ollama and loads of them are Large Language Model (LLM) Tools so hopefully you can find a suitable replacement. Other interesting Large Language Model (LLM) Tool alternatives to Ollama are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client.
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.




AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.




Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).




NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.




OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.




Mocolamma is an Ollama management application for macOS and iOS / iPadOS that connects to Ollama servers to manage models and perform chat tests using models stored on the Ollama server.




Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.



Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.






LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

