node-llama-cpp is described as 'Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level' and is an app in the ai tools & services category. There are more than 10 alternatives to node-llama-cpp for a variety of platforms, including Mac, Linux, Windows, Flatpak and Flathub apps. The best node-llama-cpp alternative is Ollama, which is both free and Open Source. Other great apps like node-llama-cpp are Jan.ai, Alpaca - Ollama Client, LM Studio and Google AI Edge Gallery.
Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.
Open-source offline AI platform supports local LLMs including Llama, Gemma, Qwen, GPT-oss, integrates cloud services like OpenAI and Anthropic, enables custom assistant creation, offers OpenAI-compatible API on localhost, operates across diverse hardware and ensures privacy.
Alpaca is an Ollama client where you can manage and chat with multiple models, Alpaca provides an easy and begginer friendly way of interacting with local AI.
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
An open-source platform for seamless automation in engineering tasks, providing local execution and control. Customizable with any LLM for enhanced autonomy, enabling developers to efficiently handle debugging to deployment tasks while preserving privacy.
Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.
Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.
OfflineLLM is unlimited, private, offline, 24/7, free access to AI. Augment your day-to-day life by using this Ai chatbot for a multiplicity of applications.
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
AI edge infrastructure for macOS. Run local or cloud models, share tools across apps via MCP, and power AI workflows with a native, always-on runtime.
United States
Singapore
Costa Rica
France
EU
Bulgaria