node-llama-cpp Alternatives

node-llama-cpp is described as 'Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level' and is an app in the ai tools & services category. There are more than 10 alternatives to node-llama-cpp for a variety of platforms, including Mac, Linux, Windows, Flatpak and Flathub apps. The best node-llama-cpp alternative is Ollama, which is both free and Open Source. Other great apps like node-llama-cpp are Jan.ai, Alpaca - Ollama Client, LM Studio and Google AI Edge Gallery.

Copy a direct link to this comment to your clipboard
node-llama-cpp alternatives page was last updated

Alternatives list

  1. Dione icon
     3 likes

    Dione makes installing complex applications as simple as clicking a button — no terminal or technical knowledge needed. For developers, Dione offers a zero-friction way to distribute apps using just a JSON file. App installation has never been this effortless.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
     
  2. Follamac icon
     5 likes

    You need Ollama running on your localhost with some model. Once Ollama is running the model can be pulled from Follamac or from command line. From command line type something like: Ollama pull llama3 If you wish to pull from Follamac you can write llama3 into "Model name to...

    Cost / License

    • Free
    • Open Source (MIT)

    Application types

    Platforms

    • Linux
    • Flathub
    • Flatpak
    • Mac
    • Windows
    • BSD
     
  3.  1 like

    A local device focused AI assistant built in Rust — persistent memory, autonomous tasks, ~27MB binary. Inspired by and compatible with OpenClaw.

    Cost / License

    Application type

    Platforms

    • Rust
    • Mac
    • Linux
    • Windows
    • BSD
    • Docker
    • Node.JS
     
  4. RamaLama icon
     1 like

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Linux
    • Mac
    • Python
     
  5. Cloudflare Workers AI provides a serverless platform to execute AI models utilizing GPUs in its network, eliminating infrastructure needs. Access over 50 open-source models, use AI Gateway for app control, and deploy globally with tools like Vectorize, R2, and D1.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
     
  6. QVAC converts local AI into a high-quality experience that sits in your pocket. All the value you’re used to seeing in other AI assistants, minus the lack of privacy.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Mac
    • Linux
    • Windows
    • Flathub
    • Flatpak
     
You are at page 2 of node-llama-cpp alternatives