Apps similar to KoboldCpp include GPT4ALL, which is open source but paid. LM Studio and Pinokio are free. Other options are Dream Novel, llama.cpp, Onit AI and local.ai. There's no shortage of AI Writing Tools like KoboldCpp, with more than 50 alternatives for the web, Mac, Windows, Linux and Android.
Locally runs open-source chatbots focused on privacy using consumer CPUs, requiring no internet or GPU. Supports multiple models, custom settings, code and dialogue generation, integrated model downloader, familiar chat UI, and both MIT and enterprise licensing.
United States
Enables running large language models entirely offline on desktop with integrated chat UI, OpenAI-compatible server, HuggingFace downloads, model discovery, support for multiple LLM formats and architectures, local privacy, GPU/CPU operation, and quick setup.
United States
Install, run & control servers, bots, databases, AI apps, terminal apps, or anything on your computer with 1 click.
Dream Novel is an AI-powered visual novel platform where every story adapts to your choices. Create dynamic, branching narratives with evolving characters and immersive worlds - no two playthroughs are the same.
France
EU
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
BulgariaEU
Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.
United States
OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.
SillyTavern is a user interface you can install on your computer (and Android phones) that allows you to interact with text generation AIs and chat/roleplay with characters you or the community create.
NovelAI is a monthly subscription service for AI-assisted authorship, storytelling, virtual companionship, or simply a GPT-J powered sandbox for your imagination.
United States
AI Dungeon is the first limitless text adventure game of its kind built with extremely advanced artificial intelligence using a massive deep neural network at its core.
United States
Sudowrite is the non-judgemental, infinitely creative AI writing tool that helps you turn half-finished first drafts into fully published work.
