node-llama-cpp Alternatives

node-llama-cpp is described as 'Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level' and is an app. There are more than 10 alternatives to node-llama-cpp for a variety of platforms, including Mac, Linux, Windows, Flathub and Flatpak apps. The best node-llama-cpp alternative is Ollama, which is both free and Open Source. Other great apps like node-llama-cpp are Jan.ai, Alpaca - Ollama Client, LM Studio and Google AI Edge Gallery.

Copy a direct link to this comment to your clipboard
node-llama-cpp alternatives page was last updated

Alternatives list

  1. Ollama icon
     131 likes

    Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.

    84 Ollama alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
     
  2. Jan.ai icon
     98 likes

    Open-source offline AI platform supports local LLMs including Llama, Gemma, Qwen, GPT-oss, integrates cloud services like OpenAI and Anthropic, enables custom assistant creation, offers OpenAI-compatible API on localhost, operates across diverse hardware and ensures privacy.

    233 Jan.ai alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    • Flathub
    • Flatpak
     
  3. Alpaca is an Ollama client where you can manage and chat with multiple models, Alpaca provides an easy and begginer friendly way of interacting with local AI.

    175 Alpaca - Ollama Client alternatives

    Cost / License

    Platforms

    • Linux
    • Flathub
    • Flatpak
     
  4. Goose OSS icon
     13 likes

    An open-source platform for seamless automation in engineering tasks, providing local execution and control. Customizable with any LLM for enhanced autonomy, enabling developers to efficiently handle debugging to deployment tasks while preserving privacy.

    124 Goose OSS alternatives

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
     
  5. Onit AI icon
     10 likes

    Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.

    44 Onit AI alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
     
  6. local.ai icon
     21 likes

    🎒 local.ai - Run AI locally on your PC!.

    Cost / License

    Alerts

    • Discontinued

    Platforms

    • Mac
    • Windows
    • Linux
     
  7. Backyard AI icon
     14 likes

    Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
     
  8. OfflineLLM icon
     8 likes

    OfflineLLM is unlimited, private, offline, 24/7, free access to AI. Augment your day-to-day life by using this Ai chatbot for a multiplicity of applications.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • visionOS
     
  9. Osaurus icon
     2 likes

    AI edge infrastructure for macOS. Run local or cloud models, share tools across apps via MCP, and power AI workflows with a native, always-on runtime.

    49 Osaurus alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
     
  10. Dione icon
     3 likes

    Dione makes installing complex applications as simple as clicking a button — no terminal or technical knowledge needed. For developers, Dione offers a zero-friction way to distribute apps using just a JSON file. App installation has never been this effortless.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
     
12 of 19 node-llama-cpp alternatives