node-llama-cpp Alternatives

Apps similar to node-llama-cpp include Ollama, which is free and open source. Other options are Jan.ai, LM Studio, Alpaca - Ollama Client and Goose OSS. You can choose from more than 10 Large Language Model (LLM) Tools like node-llama-cpp for Mac, Linux, Windows, the web and Android.

Copy a direct link to this comment to your clipboard
Alternatives
node-llama-cpp alternatives page was last updated

Alternatives list

  1. Dione icon
     4 likes

    Dione makes installing complex applications as simple as clicking a button — no terminal or technical knowledge needed. For developers, Dione offers a zero-friction way to distribute apps using just a JSON file. App installation has never been this effortless.

    Cost / License

    • Free
    • Open Source (MIT)

    Alerts

    • Discontinued

    Platforms

    • Mac
    • Windows
    • Linux
    Good alternative?
     
  2.  2 likes

    A local device focused AI assistant built in Rust — persistent memory, autonomous tasks, ~27MB binary. Inspired by and compatible with OpenClaw.

    Cost / License

    Application type

    Platforms

    • Rust
    • Mac
    • Linux
    • Windows
    • BSD
    • Docker
    • Node.JS
    Good alternative?
     
  3. Follamac icon
     5 likes

    You need Ollama running on your localhost with some model. Once Ollama is running the model can be pulled from Follamac or from command line. From command line type something like: Ollama pull llama3 If you wish to pull from Follamac you can write llama3 into "Model name to...

    73 Follamac alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Linux
    • Flathub
    • Flatpak
    • Mac
    • Windows
    • BSD
    Good alternative?
     
  4. RamaLama icon
     1 like

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Linux
    • Mac
    • Python
    Good alternative?
     
  5. Cloudflare Workers AI provides a serverless platform to execute AI models utilizing GPUs in its network, eliminating infrastructure needs. Access over 50 open-source models, use AI Gateway for app control, and deploy globally with tools like Vectorize, R2, and D1.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Good alternative?
     
  6. Janus is a single Go binary that runs .gguf models on your machine and exposes an OpenAI-compatible API. Point Cursor, Cline, or any local or cloud LLM, or AI tool with compatible OpenAI API endpoints at localhost — no Python, no Docker.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Linux
    • Mac
    Good alternative?
     
  7. QVAC converts local AI into a high-quality experience that sits in your pocket. All the value you’re used to seeing in other AI assistants, minus the lack of privacy.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Mac
    • Windows
    • Linux
    • Flathub
    • Flatpak
    • Android
    • iPhone
    Good alternative?
     
  8. Jellybox icon
     1 like

    Run AI models locally and entirely offline.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Windows
    • Mac
    Good alternative?
     
You are at page 2 of node-llama-cpp alternatives