KoboldCpp is described as 'Easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI' and is a large language model (llm) tool in the ai tools & services category. There are more than 10 alternatives to KoboldCpp for a variety of platforms, including Mac, Windows, Linux, Android and Self-Hosted apps. The best KoboldCpp alternative is GPT4ALL, which is both free and Open Source. Other great apps like KoboldCpp are LM Studio, Pinokio, Onit AI and local.ai.
Locally runs open-source chatbots focused on privacy using consumer CPUs, requiring no internet or GPU. Supports multiple models, custom settings, code and dialogue generation, integrated model downloader, familiar chat UI, and both MIT and enterprise licensing.
Install, run & control servers, bots, databases, AI apps, terminal apps, or anything on your computer with 1 click.
Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.
Tool for downloading AI and machine learning models from Hugging Face, Model Scope, and Civitai on Windows, featuring command line and GUI options, efficient management of large file downloads, integrity checks, and progress monitoring for users.
Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
SillyTavern is a user interface you can install on your computer (and Android phones) that allows you to interact with text generation AIs and chat/roleplay with characters you or the community create.
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.
This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
United States
France
EU
China
