node-llama-cpp Alternatives

node-llama-cpp is described as 'Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level' and is an app. There are more than 10 alternatives to node-llama-cpp for a variety of platforms, including Mac, Linux, Windows, Flathub and Web-based apps. The best node-llama-cpp alternative is Ollama, which is both free and Open Source. Other great apps like node-llama-cpp are Jan.ai, Alpaca - Ollama Client, LM Studio and Google AI Edge Gallery.

More about node-llama-cpp
Copy a direct link to this comment to your clipboard
node-llama-cpp alternatives page was last updated

Alternatives list

  1. Ollama icon

    Ollama

     115 likes
    Copy a direct link to this comment to your clipboard

    Supports local deployment of Llama 3, Code Llama, and other language models, enabling users to customize and create personalized models. Ideal for AI development, it offers flexibility for offline AI needs and integrates AI writing and chatbot tools in local setups.

    62 Ollama alternatives

    Cost / License

    • Free
    • Open Source

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    Ollama screenshot 1
     

    • Ollama is the most popular Windows, Mac & Linux alternative to node-llama-cpp.

    • Ollama is the most popular Open Source & free alternative to node-llama-cpp.

    • Ollama is Free and Open Sourcenode-llama-cpp is also Free and Open Source
    • Ollama is Privacy focusednode-llama-cpp is not according to our users
  2. Jan.ai icon

    Jan.ai

     81 likes
    Copy a direct link to this comment to your clipboard

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    168 Jan.ai alternatives

    Cost / License

    • Free
    • Open Source

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    • Flathub
    • Flatpak
    • Online
    Jan.ai screenshot 1
     

    • Jan.ai is the most popular Web-based alternative to node-llama-cpp.

    • Jan.ai is Free and Open Sourcenode-llama-cpp is also Free and Open Source
    • Jan.ai is Privacy focused, Customizable and Lightweightnode-llama-cpp is not according to our users
  6. Google AI Edge Gallery icon

    Google AI Edge Gallery

     14 likes
    Copy a direct link to this comment to your clipboard

    A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

    49 Google AI Edge Gallery alternatives

    Cost / License

    • Free
    • Open Source

    Application types

    Platforms

    • Android
    • Android Tablet
    Google AI Edge Gallery screenshot 1
     

    • Google AI Edge Gallery is the most popular Android & Android Tablet alternative to node-llama-cpp.

    • Google AI Edge Gallery is Free and Open Sourcenode-llama-cpp is also Free and Open Source
  7. codename goose icon

    codename goose

     11 likes
    Copy a direct link to this comment to your clipboard

    An open-source platform for seamless automation in engineering tasks, providing local execution and control. Customizable with any LLM for enhanced autonomy, enabling developers to efficiently handle debugging to deployment tasks while preserving privacy.

    87 codename goose alternatives

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    codename goose screenshot 1
     
  9. Onit AI Copilot icon

    Onit AI Copilot

     9 likes
    Copy a direct link to this comment to your clipboard

    Onit AI Copilot offers a comprehensive desktop AI chat assistant with local processing and multi-provider support. It prioritizes customization, extensibility, and user privacy by operating entirely on-device without needing an internet connection, ensuring data security.

    35 Onit AI Copilot alternatives

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    Onit AI Copilot screenshot 1
     
  10. local.ai icon

    local.ai

     20 likes
    Copy a direct link to this comment to your clipboard

    🎒 local.ai - Run AI locally on your PC!.

    40 local.ai alternatives

    Cost / License

    • Free
    • Open Source

    Alerts

    • Discontinued

    Platforms

    • Mac
    • Windows
    • Linux
    local.ai screenshot 1
     
  12. OfflineLLM icon

    OfflineLLM

     8 likes
    Copy a direct link to this comment to your clipboard

    OfflineLLM is unlimited, private, offline, 24/7, free access to AI. Augment your day-to-day life by using this Ai chatbot for a multiplicity of applications.

    Cost / License

    • Pay once
    • Proprietary

    Application types

    Platforms

    • visionOS
    OfflineLLM screenshot 1
     

    • OfflineLLM is the most popular commercial alternative to node-llama-cpp.

    • OfflineLLM is Paid and Proprietarynode-llama-cpp is Free and Open Source
  13. Dione icon

    Dione

     3 likes
    Copy a direct link to this comment to your clipboard

    Dione makes installing complex applications as simple as clicking a button — no terminal or technical knowledge needed. For developers, Dione offers a zero-friction way to distribute apps using just a JSON file. App installation has never been this effortless.

    8 Dione alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    Dione screenshot 1
     
  14. Follamac icon

    Follamac

     5 likes
    Copy a direct link to this comment to your clipboard

    You need Ollama running on your localhost with some model. Once Ollama is running the model can be pulled from Follamac or from command line. From command line type something like: Ollama pull llama3 If you wish to pull from Follamac you can write llama3 into "Model name to...

    Cost / License

    • Free
    • Open Source

    Application types

    Platforms

    • Linux
    • Flathub
    • Flatpak
    • Mac
    • Windows
    • BSD
    Follamac screenshot 1
     
12 of 16 node-llama-cpp alternatives