Apps similar to node-llama-cpp include Ollama, which is free and open source. Other options are Jan.ai, LM Studio, Alpaca - Ollama Client and Goose OSS. You can choose from more than 10 Large Language Model (LLM) Tools like node-llama-cpp for Mac, Linux, Windows, the web and Android.
Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.
United States
Open-source offline AI platform supports local LLMs including Llama, Gemma, Qwen, GPT-oss, integrates cloud services like OpenAI and Anthropic, enables custom assistant creation, offers OpenAI-compatible API on localhost, operates across diverse hardware and ensures privacy.
Singapore
Enables running large language models entirely offline on desktop with integrated chat UI, OpenAI-compatible server, HuggingFace downloads, model discovery, support for multiple LLM formats and architectures, local privacy, GPU/CPU operation, and quick setup.
United States
Alpaca is an Ollama client where you can manage and chat with multiple models, Alpaca provides an easy and begginer friendly way of interacting with local AI.
Costa Rica
An open-source platform for seamless automation in engineering tasks, providing local execution and control. Customizable with any LLM for enhanced autonomy, enabling developers to efficiently handle debugging to deployment tasks while preserving privacy.
United States
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
United States
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Bulgaria
EU
Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.
United States
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.
Local AI agents on your Mac. Private, offline, free. Open models run on Apple Silicon; add ChatGPT, Claude or Gemini only when you choose.
United States
France
